By Warren B. Powell
Praise for the First Edition
"Finally, a ebook dedicated to dynamic programming and written utilizing the language of operations examine (OR)! this gorgeous ebook fills a spot within the libraries of OR experts and practitioners."
This re-creation showcases a spotlight on modeling and computation for advanced periods of approximate dynamic programming problems
Understanding approximate dynamic programming (ADP) is key with a view to enhance sensible and top of the range options to advanced business difficulties, rather whilst these difficulties contain making judgements within the presence of uncertainty. Approximate Dynamic Programming, moment version uniquely integrates 4 designated disciplines—Markov selection methods, mathematical programming, simulation, and statistics—to reveal the best way to effectively procedure, version, and clear up quite a lot of real-life difficulties utilizing ADP.
The ebook keeps to bridge the distance among laptop technology, simulation, and operations examine and now adopts the notation and vocabulary of reinforcement studying in addition to stochastic seek and simulation optimization. the writer outlines the basic algorithms that function a kick off point within the layout of sensible recommendations for genuine difficulties. the 3 curses of dimensionality that impression complicated difficulties are brought and certain assurance of implementation demanding situations is supplied. The Second Edition additionally features:
A new bankruptcy describing 4 basic sessions of guidelines for operating with assorted stochastic optimization difficulties: myopic rules, look-ahead rules, coverage functionality approximations, and regulations according to price functionality approximations
A new bankruptcy on coverage seek that brings jointly stochastic seek and simulation optimization suggestions and introduces a brand new type of optimum studying strategies
Updated insurance of the exploration exploitation challenge in ADP, now together with a lately built strategy for doing lively studying within the presence of a actual country, utilizing the concept that of the data gradient
A new series of chapters describing statistical tools for approximating worth features, estimating the worth of a set coverage, and price functionality approximation whereas trying to find optimum policies
The awarded assurance of ADP emphasizes types and algorithms, targeting similar purposes and computation whereas additionally discussing the theoretical aspect of the subject that explores proofs of convergence and fee of convergence. A similar site positive factors an ongoing dialogue of the evolving fields of approximation dynamic programming and reinforcement studying, in addition to extra readings, software program, and datasets.
Requiring just a simple figuring out of facts and chance, Approximate Dynamic Programming, moment variation is a wonderful ebook for commercial engineering and operations study classes on the upper-undergraduate and graduate degrees. It additionally serves as a worthy reference for researchers and execs who make the most of dynamic programming, stochastic programming, and keep an eye on concept to resolve difficulties of their daily work.