Tag: #unsloth
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
LLM Fine-tuning Frameworks 2026 — A Deep Dive into Axolotl, Unsloth, LLaMA-Factory, TRL, PEFT, and TorchTune
A complete map of the 2026 LLM fine-tuning ecosystem. Open-source frameworks like Axolotl, Unsloth, LLaMA-Factory, TRL, PEFT, and TorchTune. LLM Foundry (MosaicML, acquired by Databricks). Cloud fine-tuning APIs from Mod
2026-05-16 · 28 min read #llm#finetuning#axolotl#unsloth#llama-factoryLLM Fine-Tuning 2026 Deep Dive — LoRA · QLoRA · DoRA · GaLore · Unsloth · Axolotl · TRL · PEFT · MLX-LM Complete Guide
In 2026, the LLM fine-tuning ecosystem has exploded from the simple adapters of LoRA into a sprawling tree — QLoRA at 4-bit, DoRA with weight decomposition, GaLore with gradient projection. Hugging Face PEFT 0.14 and TRL
2026-05-16 · 24 min read #llm-fine-tuning#lora#qlora#dora#galoreComplete Guide to LLM Fine-tuning with Unsloth 2025: QLoRA, 4-bit Quantization, 2x Faster Training
Everything about LLM fine-tuning with Unsloth! QLoRA/LoRA theory, 4-bit quantization (bitsandbytes), Unsloth 2x speed secret, Llama 3/Mistral/Qwen fine-tuning, data preparation, training config, VRAM optimization, GGUF/G
2026-03-25 · 17 min read #unsloth#llm#fine-tuning#qlora#lora