Tag: #accelerate
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Distributed Training & GPU Infrastructure 2026 Deep-Dive — DeepSpeed, FSDP2, Megatron-LM, Ray Train, JAX, TorchTitan, Blackwell GB200, MI325X, TPU v5p
A comparison of DeepSpeed, FSDP2, Megatron-LM, Ray Train, JAX, TorchTitan, and Composer — plus NVIDIA Blackwell GB200 NVL72, AMD MI325X, Intel Gaudi 3, AWS Trainium 2, and Google TPU v5p/v6e Trillium. 3D parallelism, ZeR
2026-05-16 · 14 min read #distributed-training#deepspeed#fsdp#megatron-lm#rayHuggingFace Ecosystem Complete Guide: Master Transformers, Datasets, PEFT, and Accelerate
A complete guide to mastering the entire HuggingFace ecosystem. Learn Transformers, Datasets, Tokenizers, PEFT, Accelerate, Diffusers, and Hub API with hands-on examples.
2026-03-17 · 18 min read #huggingface#transformers#peft#accelerate#nlp