Tag: #alignment
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 7 posts
What Transfers Through Distillation and What Does Not — Distilling DeepSeek into GPT-OSS Did Not Bring the Censorship Along
CTGT's experiment, posted to Show HN on July 30, 2026, reports that distilling financial reasoning from DeepSeek V4 Flash as the teacher into GPT-OSS as the student carried the capability over but not the political censo
2026-07-31 · 12 min read #ai#llm#distillation#alignment#open-weightsWhy RLHF Models Game Their Rewards — The Mechanisms, Symptoms, and Mitigations of Reward Hacking
"Reward Hacking in the Era of Large Models," posted to arXiv in April 2026 by Xiaohua Wang and 22 co-authors, is a survey of why and how RLHF-aligned large models game their reward signals. Its central proposal is the Pr
2026-07-11 · 5 min read #ai#llm#alignment#rlhf#safetyRobot Safety and Alignment — Trusting Powerful Robots
How can we trust increasingly powerful robots. We take a balanced look at physical safety, constrained reinforcement learning and safety layers, handling distribution shift, human-robot collaboration safety, verification
2026-06-29 · 17 min read #ai-papers#robotics#safety#alignment#reinforcement-learningAI Safety & Alignment Complete Guide 2025: Responsible AI, RLHF, Constitutional AI, Red Teaming
Everything about AI Safety! Alignment problem (goal alignment), RLHF/DPO/Constitutional AI, Bias detection/mitigation, Hallucination prevention, Red team testing, AI Guardrails, Interpretability (SHAP/LIME), EU AI Act, E
2026-04-14 · 25 min read #ai-safety#alignment#responsible-ai#rlhf#constitutional-aiAI Ethics, Safety, and Alignment Complete Guide: Responsible AI Development
A complete guide to understanding AI ethics, safety, and alignment. Covers hallucination, bias, privacy, RLHF, Constitutional AI, and the frontiers of AI safety research — everything an AI developer must know.
2026-03-17 · 22 min read #ai-ethics#ai-safety#alignment#responsible-ai#llmFrom RLHF to DPO: A Deep Dive into LLM Alignment Techniques
A comprehensive survey of key LLM alignment papers. We analyze the InstructGPT RLHF pipeline, Anthropic Constitutional AI, the mathematical foundations of DPO, PPO training stability, and recent methods like KTO, IPO, an
2026-03-13 · 12 min read #ai-papers#rlhf#dpo#alignment#ppoFrom DPO to KTO: Latest Human Feedback Alignment Techniques Paper Review and Practical Implementation
Paper review and TRL-based practical implementation guide covering the latest human feedback alignment techniques such as DPO, IPO, and KTO that overcome RLHF limitations. Algorithm comparison, hyperparameter tuning, and
2026-03-05 · 22 min read #ai-papers#dpo#kto#alignment#2026-03