Ieee Transactions On Pattern Analysis And Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence

Learning-Based Control

The recent success of Reinforcement Learning and related methods can be attributed to several key factors. First, it is driven by reward signals obtained through the interaction with the environment. Second, it is closely related to the human learning behavior. Third, it has a solid mathematical foundation. Nonetheless, conventional Reinforcement Learning theory exhibits some shortcomings particularly in a continuous environment or in considering the stability and robustness of the controlled process. In this monograph, the authors build on Reinforcement Learning to present a learning-based approach for controlling dynamical systems from real-time data and review some major developments in this relatively young field. In doing so the authors develop a framework for learning-based control theory that shows how to learn directly suboptimal controllers from input-output data. There are three main challenges on the development of learning-based control. First, there is a need to generalize existing recursive methods. Second, as a fundamental difference between learning-based control and Reinforcement Learning, stability and robustness are important issues that must be addressed for the safety-critical engineering systems such as self-driving cars. Third, data efficiency of Reinforcement Learning algorithms need be addressed for safety-critical engineering systems. This monograph provides the reader with an accessible primer on a new direction in control theory still in its infancy, namely Learning-Based Control Theory, that is closely tied to the literature of safe Reinforcement Learning and Adaptive Dynamic Programming.

Machine Vision

This 2004 book is an accessible and comprehensive introduction to machine vision. It provides all the necessary theoretical tools and shows how they are applied in actual image processing and machine vision systems. A key feature is the inclusion of many programming exercises that give insights into the development of practical image processing algorithms. The authors begin with a review of mathematical principles and go on to discuss key issues in image processing such as the description and characterization of images, edge detection, restoration and feature extraction, segmentation, texture and shape. They also discuss image matching, statistical pattern recognition, clustering, and syntactic pattern recognition. Important applications are described, including optical character recognition and automatic target recognition. Software and data used in the book can be found at www.cambridge.org/9780521830461. A useful reference for practitioners, the book is aimed at graduate students in electrical engineering, computer science and mathematics.