Tag: #distributed-ml
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Distributed Systems Complete Guide: From CAP Theorem to Distributed ML Training and Kafka
A comprehensive guide to distributed systems for AI engineers, covering CAP theorem, Raft consensus, Kafka message queues, Ring-AllReduce distributed ML training, and NCCL.
2026-03-17 · 17 min read #distributed-systems#kafka#raft#pytorchdistributed#nccl