Tag: #cost-control
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
The Complete LLMOps Guide: Three-Axis Versioning of Model, Prompt, and Eval Set, Canary, Cost Control, and the Platform Team (2025)
Building an LLM product fast has become easy. Running it sustainably is the hard part. Three-axis versioning across model, prompt, and eval set; Shadow/Canary/Blue-Green deployment; cost control through tokens, caching,
2026-04-15 · 11 min read #llmops#mlops#devops#canary#cost-controlCloudflare AI Gateway Practical Guide: Observability, Reliability, and Cost Control for AI Traffic
A practical, current guide to Cloudflare AI Gateway as of April 12, 2026, covering observability, caching, retries, rate limiting, model fallback, and Dynamic Routing.
2026-04-12 · 5 min read #ai-platform#cloudflare#ai-gateway#observability#caching