A 3d Anthropometric Muscle Based Active Appearance Model For Model Based Video Coding

Multimedia Image and Video Processing

As multimedia applications have become part of contemporary daily life, numerous paradigm-shifting technologies in multimedia processing have emerged over the last decade. Substantially updated with 21 new chapters, Multimedia Image and Video Processing, Second Edition explores the most recent advances in multimedia research and applications. This edition presents a comprehensive treatment of multimedia information mining, security, systems, coding, search, hardware, and communications as well as multimodal information fusion and interaction. Clearly divided into seven parts, the book begins with a section on standards, fundamental methods, design issues, and typical architectures. It then focuses on the coding of video and multimedia content before covering multimedia search, retrieval, and management. After examining multimedia security, the book describes multimedia communications and networking and explains the architecture design and implementation for multimedia image and video processing. It concludes with a section on multimedia systems and applications. Written by some of the most prominent experts in the field, this updated edition provides readers with the latest research in multimedia processing and equips them with advanced techniques for the design of multimedia systems.

A 3D Anthropometric Muscle-based Active Appearance Model for Model-based Video Coding

A Three-dimensional Anthropometric Muscle-based Active Appearance Model for Model-based Video Coding

The work of this thesis focuses in key areas of human-computer interaction (HCI), namely rigid facial motion recovery and facial expression analysis, and interpretation. Rigid motion recovery from image sequences is based on Structure-From-Motion (SFM) using Kalman Filter-based recursive algorithms. Facial expression analysis is performed by an Active Appearance Model (AAM), which is a statistical model, based on the estimation of linear models of shape and texture variation. The thesis integrates new developed algorithms into an Automatic Facial Tracking System (AFTS) for a low bit-rate videophone system. The first contribution of this thesis is a new method for modeling the shape and appearance of three-dimensional (3D) human faces using a constrained 3D Active Appearance Model (AAM). The proposed algorithm is an extension of the classical 2D Active Appearance Model. It uses a generic 3D wireframe model of the face, based on two sets of controls: the anatomically motivated muscle actuators to model facial expressions and statistically based anthropometrical controls to model different facial types (3D Anthropometric Muscle-Based Active Appearance Model (3D AMB AAM). This allows describing a facial image in terms of a controlled model parameter set, hence providing both, a natural and a constrained basis for face segmentation and analysis. The generated face models are consequently simpler and less memory intensive compared to the classical appearance based models. The proposed method provides accurate fitting results by constraining solutions to be valid instances of a face model. Extensive image segmentation experiments demonstrate the accuracy of the proposed algorithm against the classical AAM. The second contribution of this thesis is a new 3D tracking algorithm allowing real-time recovery of 3D position, orientation and facial expressions of a moving head. The described method uses a recursive motion estimation algorithm, namely an Extended Kalman Filter (EFK) to extract the head pose (global motion) and the newly developed 3D AMB AAM to extract the facial expressions (local motion). The resulting motion tracking system works in a realistic environment without makeup on the face, with an uncalibrated camera, and unknown lighting conditions and background. In order to validate the accuracy of the 3D head tracking system, a rapid calibration technique was developed using a sequence of images of a synthetic "standard" 3D head in lieu of a real head.