Abstract Dynamic Programming Second Edition
Download Abstract Dynamic Programming Second Edition PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Abstract Dynamic Programming Second Edition book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Abstract Dynamic Programming
Author: Dimitri Bertsekas
language: en
Publisher: Athena Scientific
Release Date: 2018-02-01
A research monograph providing a synthesis of old research on the foundations of dynamic programming, with the modern theory of approximate dynamic programming and new research on semicontractive models. It aims at a unified and economical development of the core theory and algorithms of total cost sequential decision problems, based on the strong connections of the subject with fixed point theory. The analysis focuses on the abstract mapping that underlies dynamic programming and defines the mathematical character of the associated problem. The discussion centers on two fundamental properties that this mapping may have: monotonicity and (weighted sup-norm) contraction. It turns out that the nature of the analytical and algorithmic DP theory is determined primarily by the presence or absence of these two properties, and the rest of the problem's structure is largely inconsequential. New research is focused on two areas: 1) The ramifications of these properties in the context of algorithms for approximate dynamic programming, and 2) The new class of semicontractive models, exemplified by stochastic shortest path problems, where some but not all policies are contractive. The 2nd edition aims primarily to amplify the presentation of the semicontractive models of Chapter 3 and Chapter 4 of the first (2013) edition, and to supplement it with a broad spectrum of research results that I obtained and published in journals and reports since the first edition was written (see below). As a result, the size of this material more than doubled, and the size of the book increased by nearly 40%. The book is an excellent supplement to several of our books: Dynamic Programming and Optimal Control (Athena Scientific, 2017), and Neuro-Dynamic Programming (Athena Scientific, 1996).
A Course in Reinforcement Learning: 2nd Edition
Author: Dimitri Bertsekas
language: en
Publisher: Athena Scientific
Release Date: 2024-12-20
This is the 2nd edition of the textbook used at the author's ASU research-oriented course on Reinforcement Learning (RL), offered in each of the last six years. Its purpose is to give an overview of the RL methodology, particularly as it relates to problems of optimal and suboptimal decision and control, as well as discrete optimization. While in this book mathematical proofs are deemphasized, there is considerable related analysis, which supports the conclusions and can be found in the author's recent RL and DP books. These books also contain additional material on off-line training of neural networks, on the use of policy gradient methods for approximation in policy space, and on aggregation.
Dynamic Programming
Incorporating a number of the author's recent ideas and examples, Dynamic Programming: Foundations and Principles, Second Edition presents a comprehensive and rigorous treatment of dynamic programming. The author emphasizes the crucial role that modeling plays in understanding this area. He also shows how Dijkstra's algorithm is an excellent exampl