Stochastic Optimal Control: The Discrete-Time Case

· Athena Scientific

About this ebook

This research monograph, first published in 1978 by Academic Press, remains the authoritative and comprehensive treatment of the mathematical foundations of stochastic optimal control of discrete-time systems, including the treatment of the intricate measure-theoretic issues. It is an excellent supplement to the first author's Dynamic Programming and Optimal Control (Athena Scientific, 2018).

Review of the 1978 printing:"Bertsekas and Shreve have written a fine book. The exposition is extremely clear and a helpful introductory chapter provides orientation and a guide to the rather intimidating mass of literature on the subject. Apart from anything else, the book serves as an excellent introduction to the arcane world of analytic sets and other lesser known byways of measure theory."

Mark H. A. Davis, Imperial College, in IEEE Trans. on Automatic Control

Among its special features, the book:

1) Resolves definitively the mathematical issues of discrete-time stochastic optimal control problems, including Borel models, and semi-continuous models

2) Establishes the most general possible theory of finite and infinite horizon stochastic dynamic programming models, through the use of analytic sets and universally measurable policies

3) Develops general frameworks for dynamic programming based on abstract contraction and monotone mappings

4) Provides extensive background on analytic sets, Borel spaces and their probability measures

5) Contains much in depth research not found in any other textbook

About the author

Dimitri Bertsekas is McAffee Professor of Engineering at the Massachusetts Institute of Technology (MIT), and Fulton Professor of Computational Decision Making, at Arizona State University (ASU).

Steven Shreve is Orion Hoch Professor of Mathematical Sciences at the Carnegie Mellon University.

Rate this book

Tell us what you think.

Reading information

Smartphones and tablets
Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.
Laptops and computers
You can listen to audiobooks purchased on Google Play using your computer's web browser.
eReaders and other devices
To read on e-ink devices like Kobo eReaders, you'll need to download a file and transfer it to your device. Follow the detailed Help Center instructions to transfer the files to supported eReaders.