Lessons
GPU basics and how inference actually runs
intermediate · 18 min
The die
Memory hierarchy
Matmul, tiled
Inference
Reset view
A grid of SMs. Each one is a tiny warp-wide processor.
Concepts