Tag: #ppo

한국어English日本語中文

← All posts

• Reinforcement Learning Complete Guide: From DQN, PPO to RLHF and DPO for LLM Alignment

  From MDP fundamentals to DQN, PPO, SAC, RLHF, and DPO. Master the reinforcement learning techniques used for LLM alignment with PyTorch and Stable-Baselines3 code.

  2026-03-17 · 14 min read #reinforcement-learning#ppo#dqn#rlhf#dpo

• From RLHF to DPO: A Deep Dive into LLM Alignment Techniques

  A comprehensive survey of key LLM alignment papers. We analyze the InstructGPT RLHF pipeline, Anthropic Constitutional AI, the mathematical foundations of DPO, PPO training stability, and recent methods like KTO, IPO, an

  2026-03-13 · 12 min read #ai-papers#rlhf#dpo#alignment#ppo

• Reinforcement Learning Complete Guide: From Theory to the Latest Algorithms and Real Implementations

  Derives the major algorithms with their mathematics — from the core theory of MDPs and the Bellman equations through Q-Learning, DQN, Policy Gradient, A3C, PPO and SAC — and pulls together RLHF, AlphaGo and robotics appl

  2026-03-01 · 46 min read #reinforcement-learning#deep-learning#dqn#ppo#rlhf