Tag: #slurm
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
Running a GPU Cluster with Slurm — Knowing Why a Job Will Not Run Matters More Than Submitting
Everything you need to actually use Slurm on a GPU cluster in practice. Sets up the coordinate system of partition, QoS, and account first, then covers how to request GPUs, CPUs, and memory in an sbatch script and the bi
2026-08-02 · 14 min read #mlops#slurm#hpc#gpu-cluster#distributed-trainingMulti-GPU, Multi-Node Training Platforms: The Complete Map — from the Framework Ecosystem to Hands-On Slurm and Kubeflow Guides
A one-page map of the full landscape of training models across multiple GPUs and multiple nodes. The AI library and framework ecosystem map (PyTorch, JAX, HuggingFace, DeepSpeed, Ray), when to pick which parallelization
2026-07-09 · 8 min read #ai#ml#distributed-training#slurm#kubeflowMastering Slurm: A Practical Guide to the HPC/AI Cluster Workload Manager
A comprehensive, hands-on guide to the Slurm workload manager. Covers architecture (slurmctld/slurmd/slurmdbd), core concepts (Partitions/QoS/Fairshare), essential commands (sbatch/srun/salloc), GPU scheduling (GRES/MIG/
2026-03-01 · 15 min read #slurm#hpc#gpu#distributed-training#cluster