Video course · 12 chapters · 715 min · certificate
CUDA Programming Course – High-Performance Computing with GPUs
A freeCodeCamp CUDA course: the deep learning ecosystem, CUDA setup, a C/C++ refresher, how GPUs work, writing kernels, the CUDA API, fast matrix multiplication, Triton, PyTorch extensions and a final MNIST MLP project.
What you'll learn
- Set up a CUDA environment
- Explain GPU architecture
- Write CUDA kernels
- Use the CUDA API and libraries
- Optimise matrix multiplication
- Use Triton and PyTorch extensions
Chapters
12 chapters · 715:11-
16:52
01Intro Members
Intro
GPUs for HPC.
-
20:51
02Ecosystem Members
Deep learning ecosystem
Where CUDA fits.
-
9:20
03Setup Members
CUDA setup
Environment.
-
48:44
04C/C++ Members
C/C++ review
Prerequisites.
-
15:53
05GPUs Members
Intro to GPUs
How they work.
-
123:46
06Kernels Members
Writing your first kernels
Threads and blocks.
-
99:56
07API Members
The CUDA API
Libraries and calls.
-
167:14
08Matmul Members
Faster matrix multiplication
Optimisation.
-
42:07
09Triton Members
Triton
Higher-level kernels.
-
13:27
10Extensions Members
PyTorch extensions
Custom ops.
-
143:03
11Project Members
MNIST MLP project
Final project.
-
13:58
12Wrap-up Members
Next steps and outro
Keep going.