Tag: #routing
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 4 posts
MoE Routing — How an Expert Gets Picked
Reading the config fields of a mixture-of-experts layer against real models. Comparing Mixtral 2-of-8, Qwen3 8-of-128, the 256 routed experts plus a shared expert in DeepSeek-V3, and the sparsity of 48 in Kimi K2, then w
2026-08-12 · 6 min read #ai-papers#model-internals#mixture-of-experts#moe#routingWhat ROV Blocked, What ASPA Still Can't — the June 2026 Telegram Hijack and the Next Layer of Routing Security
On June 16, 2026, India's Rcom (AS18101) hijacked Telegram's prefixes, and Kentik's measurement shows the hijacked path reached only 1.6% of Kentik's own BGP sources — a case where RPKI ROV actually worked. But that's be
2026-07-16 · 23 min read #network#bgp#rpki#routing#securityCloudflare AI Gateway Practical Guide: Observability, Reliability, and Cost Control for AI Traffic
A practical, current guide to Cloudflare AI Gateway as of April 12, 2026, covering observability, caching, retries, rate limiting, model fallback, and Dynamic Routing.
2026-04-12 · 5 min read #ai-platform#cloudflare#ai-gateway#observability#cachingLLM Routing and Cascade Strategy: Cost Optimization with Multi-Model Orchestration
Covers how to optimize cost with LLM routing and cascade strategies. Builds everything from query-complexity routing, model cascades, semantic routers and the FrugalGPT approach through to a production multi-model orches
2026-03-08 · 26 min read #llm#routing#cascade#model-orchestration#cost-optimization