Finding Bottlenecks In Large Scale Parallel Programs

Finding Bottlenecks in Large Scale Parallel Programs

Performance Analysis of Parallel Applications for HPC

This book presents a hybrid static-dynamic approach for efficient performance analysis of parallel applications on HPC systems. Performance analysis is essential to finding performance bottlenecks and understanding the performance behaviors of parallel applications on HPC systems. However, current performance analysis techniques usually incur significant overhead. Our book introduces a series of approaches for lightweight performance analysis. We combine static and dynamic analysis to reduce the overhead of performance analysis. Based on this hybrid static-dynamic approach, we then propose several innovative techniques for various performance analysis scenarios, including communication analysis, memory analysis, noise analysis, computation analysis, and scalability analysis. Through these specific performance analysis techniques, we convey to readers the idea of using static analysis to support dynamic analysis. To gain the most from the book, readers should have a basic grasp of parallel computing, computer architecture, and compilation techniques.

OpenMP Shared Memory Parallel Programming

The refereed proceedings of the International Workshop on OpenMP Applications and Tools, WOMPAT 2003, held in Toronto, Canada in June 2003. The 20 revised full papers presented were carefully reviewed and selected for inclusion in the book. The papers are organized in sections on tools and tool technology, OpenMP implementations, OpenMP experience, and OpenMP on clusters.