Optimize Your Code: Intro to Profiling for HPC & AI Applications

Optimize Your Code: Intro to Profiling for HPC & AI Applications

Title: Profiling Basics: Understanding Metrics and Tools for HPC

This informative session will introduce participants to the foundational concepts of profiling in high-performance computing (HPC). The presentation will cover what profiling is and why it is crucial for optimizing code performance. Attendees will learn about key performance metrics and how to interpret them, as well as explore popular profiling tools used in HPC environments. This session aims to equip participants with the knowledge needed to understand the performance characteristics of their code and identify potential areas for optimization.
10:30 - 11:00
Title: Profiling AI Applications: Techniques and Best Practices

This session transitions into the specialized area of profiling AI applications. Participants will learn about the unique performance considerations when profiling deep learning models and AI workloads. We will introduce tools specifically designed for AI profiling, such as those that measure GPU utilization and memory bandwidth. The session will provide insights into interpreting AI-specific metrics, understanding training and inference bottlenecks, and optimizing models for better performance. Attendees will gain the knowledge needed to fine-tune their AI applications for increased efficiency.
Title: Scaling Up: Multi-GPU Parallelism for AI Models

This session transitions into the specialized area of profiling AI applications. Participants will learn about the unique performance considerations when profiling deep learning models and AI workloads. We will introduce tools specifically designed for AI profiling, such as those that measure GPU utilization and memory bandwidth. The session will provide insights into interpreting AI-specific metrics, understanding training and inference bottlenecks, and optimizing models for better performance. Attendees will gain the knowledge needed to fine-tune their AI applications for increased efficiency.
Hands-On Session: Practical Profiling for AI Applications

In this interactive hands-on session, participants will put their knowledge into practice by learning how to profile AI models effectively. The session will guide attendees through setting up profiling tools, executing profiling tasks, and analyzing performance data to optimize their AI applications. Special emphasis will be placed on demonstrating how to apply these profiling techniques in a multi-GPU environment, allowing users to explore strategies for monitoring and improving the performance of parallel processing models. By the end of this session, participants will gain practical experience and confidence in profiling and optimizing their AI workflows, both for single and multi-GPU setups.

Видео Optimize Your Code: Intro to Profiling for HPC & AI Applications канала CaSToRC Official