Data Efficient Deep Learning Of Dynamical Systems
Download Data Efficient Deep Learning Of Dynamical Systems PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Data Efficient Deep Learning Of Dynamical Systems book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Data-efficient Deep Learning of Dynamical Systems
The synergy between dynamical systems and deep learning (DL) has become an increasingly popular research topic because of the limitation of classic methods and the great potential of DL in addressing these challenges through the data-fitting and feature-extraction power of deep neural networks (DNNs). DNNs have demonstrated their ability to approximate highly complicated functions while enjoying good trainability, which can help dynamical system modeling with both the search of solution and the expressiveness of models. Furthermore, the feature extraction ability of DNNs have proven useful in identifying system states identification when the state cannot be defined from first-principles. Conversely, the study of dynamical systems has benefited DL. Viewing DNNs as discretization of ordinary differential equations (ODEs) inspires a novel family of models named neural differential equations which offer unique advantages in time series learning, especially the modeling of dynamical systems. From another perspective, viewing the optimization of deep learning models as a dynamical system on the loss landscape enables better analysis and enhancement of the optimization processes. This work focuses on this interplay. We develop novel deep learning methods to efficiently model dynamical systems, incorporating physical prior knowledge and meta-learning techniques. By analyzing the dynamics of the optimization process, we also design a novel variant of stochastic gradient descent to enhance the resilience of DNNs against weight perturbations, enabling their deployment on analog in-memory computing platforms where analog noise is inevitable. Through these investigations, we contribute to the growing body of research on the intersection of dynamical systems and deep learning, paving the way for innovative solutions to complex real-world problems.
Data-Driven Science and Engineering
Author: Steven L. Brunton
language: en
Publisher: Cambridge University Press
Release Date: 2022-05-05
A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.
Transparency and Interpretability for Learned Representations of Artificial Neural Networks
Artificial intelligence (AI) is a concept, whose meaning and perception has changed considerably over the last decades. Starting off with individual and purely theoretical research efforts in the 1950s, AI has grown into a fully developed research field of modern times and may arguably emerge as one of the most important technological advancements of mankind. Despite these rapid technological advancements, some key questions revolving around the matter of transparency, interpretability and explainability of an AI’s decision-making remain unanswered. Thus, a young research field coined with the general term Explainable AI (XAI) has emerged from increasingly strict requirements for AI to be used in safety critical or ethically sensitive domains. An important research branch of XAI is to develop methods that help to facilitate a deeper understanding for the learned knowledge of artificial neural systems. In this book, a series of scientific studies are presented that shed light on how to adopt an empirical neuroscience inspired approach to investigate a neural network’s learned representation in the same spirit as neuroscientific studies of the brain.