Tag: #llm-alignment
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Reinforcement Learning Complete Guide: From DQN, PPO to RLHF and DPO for LLM Alignment
From MDP fundamentals to DQN, PPO, SAC, RLHF, and DPO. Master the reinforcement learning techniques used for LLM alignment with PyTorch and Stable-Baselines3 code.
2026-03-17 · 14 min read #reinforcement-learning#ppo#dqn#rlhf#dpoDPO (Direct Preference Optimization) Paper Deep Analysis — LLM Alignment Without RLHF
From mathematical principles of DPO to implementation, comparison with RLHF, and variants like IPO/KTO/ORPO — an in-depth analysis of LLM preference optimization from a practical perspective.
2026-03-09 · 20 min read #ai-papers#dpo#rlhf#llm-alignment#preference-optimization