Tag: #xla
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Google TPU Deep Dive: How Systolic Arrays Solve Matrix Multiplication Perfectly
A complete technical breakdown of how Google's Systolic Array achieves extreme efficiency for matrix multiplication. From INT8 inference and bfloat16, to XLA compiler optimizations and TPU Pod distributed inference - wit
2026-03-18 · 15 min read #tpu#google#systolic-array#model-serving#jaxCompiler & Interpreter Design: From Parsers to LLVM and AI Compilers (TVM/XLA)
A comprehensive guide from lexical analysis and ASTs to LLVM IR, then all the way to AI-specific compilers like TVM and XLA. Master how torch.compile() works internally and how kernel fusion drives performance.
2026-03-17 · 15 min read #compiler#llvm#tvm#xla#mlcompiler