Tag: matmul

All the articles with the tag "matmul".

• How a GPU Runs Deep Learning: Memory, the Roofline, and a First Kernel

  Updated:24 Oct, 2026

  A GPU is thousands of simple cores fed by a memory system that is usually the real bottleneck. The H100's layout from its whitepaper, threads, warps and blocks, the roofline and why an operation's FLOPs per byte decides which ceiling it hits, then real kernels written and measured on a laptop GPU: a vector add, coalesced vs scattered reads, and a matrix multiply from naive to tiled, with the arithmetic of why tiles and matrix shapes matter.