Tag: #data-mixture
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
The Training Recipe — From Pre-training to Post-training, and What Reports Write Down
Comparing, exactly as written in the reports, the three stages and six context extensions of Llama 3, the three-stage pre-training of Qwen3, the learning-rate schedule and two-phase YaRN extension of DeepSeek-V3, and the
2026-08-12 · 6 min read #ai-papers#model-internals#pretraining#training-recipe#data-mixture