Tag: #torch-compile
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
PyTorch Internals & Advanced Optimization: autograd, torch.compile, FSDP, and Triton
A complete guide to PyTorch internals: autograd engine, torch.compile() with TorchInductor, FSDP distributed training, gradient checkpointing, and custom CUDA operations.
2026-03-17 · 10 min read #pytorch#torch-compile#fsdp#triton#mixedprecisionPyTorch Advanced Techniques Complete Guide: torch.compile, Custom Ops, Memory Optimization
A complete guide to mastering PyTorch advanced techniques. Covers torch.compile, custom operators, memory optimization, Gradient Checkpointing, torch.vmap, functorch, and PyTorch Profiler with hands-on examples.
2026-03-17 · 17 min read #pytorch#advanced#torch-compile#memory-optimization#custom-operatorsCompiler & Interpreter Design: From Parsers to LLVM and AI Compilers (TVM/XLA)
A comprehensive guide from lexical analysis and ASTs to LLVM IR, then all the way to AI-specific compilers like TVM and XLA. Master how torch.compile() works internally and how kernel fusion drives performance.
2026-03-17 · 15 min read #compiler#llvm#tvm#xla#mlcompiler