Lectures On The Calculus Of Variations And Optimal Control Theory

Lectures on the Calculus of Variations and Optimal Control Theory

This book is divided into two parts. The first addresses the simpler variational problems in parametric and nonparametric form. The second covers extensions to optimal control theory. The author opens with the study of three classical problems whose solutions led to the theory of calculus of variations. They are the problem of geodesics, the brachistochrone, and the minimal surface of revolution. He gives a detailed discussion of the Hamilton-Jacobi theory, both in the parametric and nonparametric forms. This leads to the development of sufficiency theories describing properties of minimizing extremal arcs. Next, the author addresses existence theorems. He first develops Hilbert's basic existence theorem for parametric problems and studies some of its consequences. Finally, he develops the theory of generalized curves and "automatic" existence theorems. In the second part of the book, the author discusses optimal control problems. He notes that originally these problems were formulated as problems of Lagrange and Mayer in terms of differential constraints. In the control formulation, these constraints are expressed in a more convenient form in terms of control functions. After pointing out the new phenomenon that may arise, namely, the lack of controllability, the author develops the maximum principle and illustrates this principle by standard examples that show the switching phenomena that may occur. He extends the theory of geodesic coverings to optimal control problems. Finally, he extends the problem to generalized optimal control problems and obtains the corresponding existence theorems.

Lectures on the Calculus of Variations and Optimal Control Theory

Calculus of Variations and Optimal Control Theory

This textbook offers a concise yet rigorous introduction to calculus of variations and optimal control theory, and is a self-contained resource for graduate students in engineering, applied mathematics, and related subjects. Designed specifically for a one-semester course, the book begins with calculus of variations, preparing the ground for optimal control. It then gives a complete proof of the maximum principle and covers key topics such as the Hamilton-Jacobi-Bellman theory of dynamic programming and linear-quadratic optimal control. Calculus of Variations and Optimal Control Theory also traces the historical development of the subject and features numerous exercises, notes and references at the end of each chapter, and suggestions for further study. Offers a concise yet rigorous introduction Requires limited background in control theory or advanced mathematics Provides a complete proof of the maximum principle Uses consistent notation in the exposition of classical and modern topics Traces the historical development of the subject Solutions manual (available only to teachers) Leading universities that have adopted this book include: University of Illinois at Urbana-Champaign ECE 553: Optimum Control Systems Georgia Institute of Technology ECE 6553: Optimal Control and Optimization University of Pennsylvania ESE 680: Optimal Control Theory University of Notre Dame EE 60565: Optimal Control