Tag: #constrained-decoding
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Stabilizing LLM Structured Output — Four Layers of Defense Against Parse Failures
A layered treatment for the problem where you ask for JSON and get it wrapped in a markdown fence, followed by an explanatory sentence, or cut off at the token ceiling. Classify the failure types first, then stack the de
2026-07-26 · 12 min read #llm#structured-output#json-schema#constrained-decoding#validationLLM Structured Output and Constrained Decoding Practical Guide: From JSON Schema to Production Application
A practical guide that covers everything from Constrained Decoding, the core principle of LLM structured output, to JSON Schema-based output control, comparison of Outlines·XGrammar·llguidance engines, function calling i
2026-03-07 · 23 min read #llm#structured-output#constrained-decoding#json-schema#function-calling