Tag: #dpo

한국어English日本語中文

← All posts

• Top LLM Papers 2024-2026 - Llama, DeepSeek, Qwen, Mistral, Phi, RLHF, DPO, CoT, RAG, FlashAttention, vLLM Reading List

  A curated reading list of 30+ must-read LLM papers for engineers building with LLMs in 2024-2026. Covers foundation models (Llama 3/4, DeepSeek-V3/R1, Qwen3, Mistral, Phi-4, Gemma 3), training innovations (MoE, MLA, GQA)

  2026-05-16 · 19 min read #llm#papers#llama#deepseek#qwen

• LLM Fine-tuning Frameworks 2026 — A Deep Dive into Axolotl, Unsloth, LLaMA-Factory, TRL, PEFT, and TorchTune

  A complete map of the 2026 LLM fine-tuning ecosystem. Open-source frameworks like Axolotl, Unsloth, LLaMA-Factory, TRL, PEFT, and TorchTune. LLM Foundry (MosaicML, acquired by Databricks). Cloud fine-tuning APIs from Mod

  2026-05-16 · 28 min read #llm#finetuning#axolotl#unsloth#llama-factory

• LLM Fine-Tuning 2026 Deep Dive — LoRA · QLoRA · DoRA · GaLore · Unsloth · Axolotl · TRL · PEFT · MLX-LM Complete Guide

  In 2026, the LLM fine-tuning ecosystem has exploded from the simple adapters of LoRA into a sprawling tree — QLoRA at 4-bit, DoRA with weight decomposition, GaLore with gradient projection. Hugging Face PEFT 0.14 and TRL

  2026-05-16 · 24 min read #llm-fine-tuning#lora#qlora#dora#galore

• AI Safety & Alignment 2026 Deep Dive - Constitutional AI · RLHF · DPO · GRPO · Mechanistic Interpretability · AISI Evals · Red Team

  A single-shot map of AI safety and alignment as of 2026. Starts from conceptual roots like outer/inner alignment and mesa-optimization, walks through training-time alignment (RLHF, DPO, GRPO, Constitutional AI), frontier

  2026-05-16 · 20 min read #ai-safety#ai-alignment#constitutional-ai#rlhf#dpo

• AI Engineering in Practice — LLM API, RAG, Agents, LoRA/DPO, Vector DB, Evaluation, Observability, Prompt Injection (2025)

  The real difficulty of production LLM API calls, why RAG is not simple lookup, agent patterns (ReAct, Plan-Execute, ReWOO), when to and when NOT to fine-tune (LoRA, QLoRA, DPO), a vector DB decision matrix, why LLM evalu

  2026-04-15 · 7 min read #ai-engineering#llm#rag#ai-agent#lora

• LLM Fine-tuning Complete Guide: Master LoRA, QLoRA, RLHF, and DPO

  A complete guide covering every LLM fine-tuning technique. From Full Fine-tuning to LoRA, QLoRA, RLHF, DPO, and Instruction Tuning — master them all with HuggingFace PEFT and hands-on examples.

  2026-03-17 · 21 min read #llm#fine-tuning#lora#qlora#rlhf

• Reinforcement Learning Complete Guide: From DQN, PPO to RLHF and DPO for LLM Alignment

  From MDP fundamentals to DQN, PPO, SAC, RLHF, and DPO. Master the reinforcement learning techniques used for LLM alignment with PyTorch and Stable-Baselines3 code.

  2026-03-17 · 14 min read #reinforcement-learning#ppo#dqn#rlhf#dpo

• From RLHF to DPO: A Deep Dive into LLM Alignment Techniques

  A comprehensive survey of key LLM alignment papers. We analyze the InstructGPT RLHF pipeline, Anthropic Constitutional AI, the mathematical foundations of DPO, PPO training stability, and recent methods like KTO, IPO, an

  2026-03-13 · 12 min read #ai-papers#rlhf#dpo#alignment#ppo

• DPO (Direct Preference Optimization) Paper Deep Analysis — LLM Alignment Without RLHF

  From mathematical principles of DPO to implementation, comparison with RLHF, and variants like IPO/KTO/ORPO — an in-depth analysis of LLM preference optimization from a practical perspective.

  2026-03-09 · 20 min read #ai-papers#dpo#rlhf#llm-alignment#preference-optimization

• From DPO to KTO: Latest Human Feedback Alignment Techniques Paper Review and Practical Implementation

  Paper review and TRL-based practical implementation guide covering the latest human feedback alignment techniques such as DPO, IPO, and KTO that overcome RLHF limitations. Algorithm comparison, hyperparameter tuning, and

  2026-03-05 · 22 min read #ai-papers#dpo#kto#alignment#2026-03