Parallel And High Performance Computing In Artificial Intelligence
Download Parallel And High Performance Computing In Artificial Intelligence PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Parallel And High Performance Computing In Artificial Intelligence book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Parallel and High-Performance Computing in Artificial Intelligence
Parallel and High-Performance Computing in Artificial Intelligence explores high-performance architectures for data-intensive applications as well as efficient analytical strategies to speed up data processing and applications in automation, machine learning, deep learning, healthcare, bioinformatics, natural language processing (NLP), and vision intelligence. The book’s two major themes are high-performance computing (HPC) architecture and techniques and their application in artificial intelligence. Highlights include: HPC use cases, application programming interfaces (APIs), and applications Parallelization techniques HPC for machine learning Implementation of parallel computing with AI in big data analytics HPC with AI in healthcare systems AI in industrial automation Coverage of HPC architecture and techniques includes multicore architectures, parallel-computing techniques, and APIs, as well as dependence analysis for parallel computing. The book also covers hardware acceleration techniques, including those for GPU acceleration to power big data systems. As AI is increasingly being integrated into HPC applications, the book explores emerging and practical applications in such domains as healthcare, agriculture, bioinformatics, and industrial automation. It illustrates technologies and methodologies to boost the velocity and scale of AI analysis for fast discovery. Data scientists and researchers can benefit from the book’s discussion on AI-based HPC applications that can process higher volumes of data, provide more realistic simulations, and guide more accurate predictions. The book also focuses on deep learning and edge computing methodologies with HPC and presents recent research on methodologies and applications of HPC in AI.
Parallel and High Performance Computing
Parallel and High Performance Computing offers techniques guaranteed to boost your code’s effectiveness. Summary Complex calculations, like training deep learning models or running large-scale simulations, can take an extremely long time. Efficient parallel programming can save hours—or even days—of computing time. Parallel and High Performance Computing shows you how to deliver faster run-times, greater scalability, and increased energy efficiency to your programs by mastering parallel techniques for multicore processor and GPU hardware. About the technology Write fast, powerful, energy efficient programs that scale to tackle huge volumes of data. Using parallel programming, your code spreads data processing tasks across multiple CPUs for radically better performance. With a little help, you can create software that maximizes both speed and efficiency. About the book Parallel and High Performance Computing offers techniques guaranteed to boost your code’s effectiveness. You’ll learn to evaluate hardware architectures and work with industry standard tools such as OpenMP and MPI. You’ll master the data structures and algorithms best suited for high performance computing and learn techniques that save energy on handheld devices. You’ll even run a massive tsunami simulation across a bank of GPUs. What's inside Planning a new parallel project Understanding differences in CPU and GPU architecture Addressing underperforming kernels and loops Managing applications with batch scheduling About the reader For experienced programmers proficient with a high-performance computing language like C, C++, or Fortran. About the author Robert Robey works at Los Alamos National Laboratory and has been active in the field of parallel computing for over 30 years. Yuliana Zamora is currently a PhD student and Siebel Scholar at the University of Chicago, and has lectured on programming modern hardware at numerous national conferences. Table of Contents PART 1 INTRODUCTION TO PARALLEL COMPUTING 1 Why parallel computing? 2 Planning for parallelization 3 Performance limits and profiling 4 Data design and performance models 5 Parallel algorithms and patterns PART 2 CPU: THE PARALLEL WORKHORSE 6 Vectorization: FLOPs for free 7 OpenMP that performs 8 MPI: The parallel backbone PART 3 GPUS: BUILT TO ACCELERATE 9 GPU architectures and concepts 10 GPU programming model 11 Directive-based GPU programming 12 GPU languages: Getting down to basics 13 GPU profiling and tools PART 4 HIGH PERFORMANCE COMPUTING ECOSYSTEMS 14 Affinity: Truce with the kernel 15 Batch schedulers: Bringing order to chaos 16 File operations for a parallel world 17 Tools and resources for better code
High Performance Computing
Author: Ponnuswamy Sadayappan
language: en
Publisher: Springer Nature
Release Date: 2020-06-15
This book constitutes the refereed proceedings of the 35th International Conference on High Performance Computing, ISC High Performance 2020, held in Frankfurt/Main, Germany, in June 2020.* The 27 revised full papers presented were carefully reviewed and selected from 87 submissions. The papers cover a broad range of topics such as architectures, networks & infrastructure; artificial intelligence and machine learning; data, storage & visualization; emerging technologies; HPC algorithms; HPC applications; performance modeling & measurement; programming models & systems software. *The conference was held virtually due to the COVID-19 pandemic. Chapters "Scalable Hierarchical Aggregation and Reduction Protocol (SHARP) Streaming-Aggregation Hardware Design and Evaluation", "Solving Acoustic Boundary Integral Equations Using High Performance Tile Low-Rank LU Factorization", "Scaling Genomics Data Processing with Memory-Driven Computing to Accelerate Computational Biology", "Footprint-Aware Power Capping for Hybrid Memory Based Systems", and "Pattern-Aware Staging for Hybrid Memory Systems" are available open access under a Creative Commons Attribution 4.0 International License via link.springer.com.