
Explore the AMD Rackham stack, including runtimes, compilers, libraries, and frameworks like TensorFlow and PyTorch, enabling hip programming on AMD GPUs across Unix and Linux environments.
Explore how Slurm acts as a resource manager and job scheduler for HPC, enabling resource checks, allocations, and interactive or batch jobs across nodes and partitions.
Explore how AMD GPUs organize compute units and wavefronts into SIMD work groups, and how hip enables portable CUDA-like programming across AMD and Nvidia with grids, blocks, and shared memory.
Explain how a CPU submits a kernel to the GPU, how compute units dispatch blocks and threads, and how memory coalescing improves vector add performance across HIP and CUDA.
Trace AMD GPU architectures from GCN to RDNA and Vega, including seven-nanometer tech and GF versioning, and learn kernel execution on compute units with wavefronts and memory coalescing.
Learn hip programming basics, including compiling on Nvidia systems, migrating Cuda code, and using hip kernels with memory management, templates, and printf debugging; plus matrix-vector multiplication assignment context.
Learn hip kernel programming, using global, device, and host qualifiers to launch workloads from the host and manage thread, block, and grid indices.
Explore hip memory models and the gpu memory hierarchy, from global memory to registers and shared memory, with locality, caching policies, and warp behavior to optimize amd gpu code.
Explore hip synchronization and atomic operations, race conditions, and memory fences, while learning how to compile for Nvidia with hip platform and nvcc to support reductions.
Learn why mastering tools matters for performance and how rokom info and the system management interface bridge high-level apps with hardware, then profile and debug with profiler, tracer, and debugger.
Explore HIP performance tuning by examining debugger and profiler workflows, understanding AMD GPU ISA, and mastering occupancy, memory access, and divergence concepts for efficient kernels.
Learn how hipify port cuda code to hip using heapify pearl and heapify clang, with demos like vector add, k-means, and CNN, and understand portability across AMD and NVIDIA platforms.
Learn to harness gpu parallelism with local sums, reductions, and memory coalescing through tiling and barriers. Use rock, rocblas, and hip libraries to achieve high-performance matrix operations and optimized convolutions.
Analyze a simple matrix multiplication kernel, show how tiling with shared memory reduces memory traffic, and compare naive versus tiled approaches emphasizing standard library benefits.
Master multi-GPU AMD programming by querying device counts, setting devices, and launching kernels in parallel streams; implement vector add across GPUs and explore thread, MPI, and peer-to-peer memory patterns.
Learn parallel programming on AMD GPU's with ROCm and HIP from basic concepts to advance implementations. We will start our discussion by looking at basic concepts including AMD GPU programming, execution model, and memory model. Then we will show you how to implement algorithms using ROCm and HIP.
This course is designed to teach you modern AMD GPU programming and graphics techniques without any prior knowledge of graphical theory. All you need is some C++ experience and preferably an understanding of algorithms. It compiles information about HPC, Slurm, CUDA and some basic mathematical concepts.
This course is the first course on the AMD GPU programming series covers the concepts. So the knowledge you gain here will be essential for your next AMD GPU learning ventures. This course will receive constant support, to ensure you learn everything there is to know, beyond just the basics that most other courses will teach you.
Enroll right now to learn some of the coolest techniques and boost your career with your new skills. This course is not about "remembering facts", it's about "seeing for yourself" via experimentation. It will teach you how to visualize what's happening in on the GPUs internally. If you want more than just a superficial look on GPUs, this course is for you. Credits: cover image model adapted from Freepik and some videos are adapted from creative commons AMD GPU workshops.