Tag: #gpuprogramming
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Advanced CUDA GPU Programming: Warp Optimization, Tensor Cores, and Triton Kernels
A comprehensive deep dive into CUDA memory hierarchy, Warp optimization, Tensor Core WMMA API, Flash Attention implementation, and Triton custom kernel authoring for accelerating AI model training.
2026-03-17 · 19 min read #cuda#gpuprogramming#tensorcore#triton#flash-attention