Tag: #proxy
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
LiteLLM Complete Guide 2025: Unify 100+ LLMs with a Single API Proxy Server
Everything about LiteLLM! 100+ LLM unified API, OpenAI-compatible proxy server, cost tracking/budget management, load balancing/fallback, model routing, virtual keys, rate limiting, Guardrails, production deployment (Doc
2026-03-25 · 18 min read #litellm#llm#api#proxy#openai