Tag: #model-routing
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
LLM API Cost Optimization — Break-Even Math for Output Tokens, Prompt Caching and Routing
Cutting an LLM API bill in half is arithmetic, not intuition. Because output tokens cost several times what input tokens cost, the biggest lever is almost always controlling output length, with prompt caching next. This
2026-07-26 · 12 min read #llm#cost-optimization#prompt-caching#rag#model-routingPractical LLM API Cost Optimization: How to Cut Costs by 90%
Five battle-tested strategies to slash LLM API costs — prompt caching (90% reduction), model routing, semantic caching, Batch API, and output optimization — all with production-ready code and real cost calculations.
2026-03-18 · 12 min read #llm-cost-optimization#api-cost#prompt-caching#model-routing#ai-development