From one kernel that adds two arrays to the kernels that train and run large models — threads, warps, memory, shared memory, occupancy, reductions, scans, sorting, matrix multiplication, profiling, streams, the libraries, CUDA from Python, tensor cores, attention and many GPUs. Every program was compiled and run on a real GPU and its output recorded. Thirty-one volumes, every plate in English and Chinese.