Robot Behavior Generation And Human Behavior Understanding In Natural Human Robot Interaction
Download Robot Behavior Generation And Human Behavior Understanding In Natural Human Robot Interaction PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Robot Behavior Generation And Human Behavior Understanding In Natural Human Robot Interaction book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Robot Behavior Generation and Human Behavior Understanding in Natural Human-Robot Interaction
Having a natural interaction makes a significant difference in a successful human-robot interaction (HRI). The natural HRI refers to both human multimodal behavior understanding and robot verbal or non-verbal behavior generation. Humans can naturally communicate through spoken dialogue and non-verbal behaviors. Hence, a robot should perceive and understand human behaviors so as to be capable of producing a natural multimodal and spontaneous behavior that matches the social context. In this thesis, we explore human behavior understanding and robot behavior generation for natural HRI. This includes multimodal human emotion recognition with visual information extracted from RGB-D and thermal cameras and non-verbal multimodal robot behavior synthesis.Emotion recognition based on multimodal human behaviors during HRI can help robots understand user states and exhibit a natural social interaction. In this thesis, we explored multimodal emotion recognition with thermal facial information and 3D gait data in HRI scene when the emotion cues from thermal face and gait data are difficult to disguise. A multimodal database with thermal face images and 3D gait data was built through the HRI experiments. We tested the various unimodal emotion classifiers (i.e., CNN, HMM, Random Forest model, SVM) and one decision-based hybrid emotion classifier on the database for offline emotion recognition. We also explored an online emotion recognition system with limited capability in the real-time HRI setting. Interaction plays a critical role in skills learning for natural communication. Robots can get feedback during the interaction to improve their social abilities in HRI.To improve our online emotion recognition system, we developed an interactive robot learning (IRL) model with the human in the loop. The IRL model can apply the human verbal feedback to label or relabel the data for retraining the emotion recognition model in a long-term interaction situation. After using the interactive robot learning model, the robot could obtain a better emotion recognition accuracy in real-time HRI.The human non-verbal behaviors such as gestures and face action occur spontaneously with speech, which leads to a natural and expressive interaction. Speech-driven gesture and face action generation are vital to enable a social robot to exhibit social cues and conduct a successful HRI. This thesis proposes a new temporal GAN (Generative Adversarial Network) architecture for a one-to-many mapping from acoustic speech representation to the humanoid robot's corresponding gestures. We also developed an audio-visual database to train the speaking gesture generation model. The database includes the speech audio data extracted directly from the videos and the associated 3D human pose data extracted from 2D RGB images. The generated gestures from the trained co-speech gesture synthesizer can be applied to social robots with arms. The evaluation result shows the effectiveness of our generative model for speech-driven robot gesture generation. Moreover, we developed an effective speech-driven facial action synthesizer based on GAN, i.e., given an acoustic speech, a synchronous and realistic 3D facial action sequence is generated. A mapping between the 3D human facial actions to real robot facial actions that regulate the Zeno robot facial expression is completed. The application of co-speech non-verbal robot behaviors (gesture and face action) synthesis for the social robot can make a friendly and natural human-robot interaction.
Human-robot Interaction
Presents a unified treatment of HRI-related issues, identifies key themes, and discusses challenge problems that are likely to shape the field in the near future. The survey includes research results from a cross section of the universities, government efforts, industry labs, and countries that contribute to HRI.
Cognitive Computing for Human-Robot Interaction
Cognitive Computing for Human-Robot Interaction: Principles and Practices explores the efforts that should ultimately enable society to take advantage of the often-heralded potential of robots to provide economical and sustainable computing applications. This book discusses each of these applications, presents working implementations, and combines coherent and original deliberative architecture for human–robot interactions (HRI). Supported by experimental results, it shows how explicit knowledge management promises to be instrumental in building richer and more natural HRI, by pushing for pervasive, human-level semantics within the robot's deliberative system for sustainable computing applications. This book will be of special interest to academics, postgraduate students, and researchers working in the area of artificial intelligence and machine learning. Key features: - Introduces several new contributions to the representation and management of humans in autonomous robotic systems; - Explores the potential of cognitive computing, robots, and HRI to generate a deeper understanding and to provide a better contribution from robots to society; - Engages with the potential repercussions of cognitive computing and HRI in the real world. - Introduces several new contributions to the representation and management of humans in an autonomous robotic system - Explores cognitive computing, robots and HRI, presenting a more in-depth understanding to make robots better for society - Gives a challenging approach to those several repercussions of cognitive computing and HRI in the actual global scenario