Tag: #memory-bandwidth
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
What It Really Means to Hand-Tune a GPU Kernel — Making One Transpose Kernel 5x Faster
Starting from threads, warps, and the memory hierarchy, this post covers what it actually means to hand-modify a GPU kernel. It explains why occupancy is a symptom rather than a goal, and why most kernels are bound by me
2026-08-02 · 19 min read #cuda#gpu-kernel#nsight-compute#memory-bandwidth#performance