Tag: #rate-limiting
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 11 posts
Choosing a Rate Limiting Algorithm — What Really Separates Fixed Window, Sliding, and Token Bucket
Letting 200 requests through a 100-per-minute limit is not a bug. It is the defined behaviour of the fixed window algorithm. This post compares the memory and accuracy tradeoffs of four approaches — fixed window, sliding
2026-07-26 · 12 min read #web#rate-limiting#api-design#redis#reliabilityIngress Rate Limiting and DDoS Mitigation: A Practical Guide from ingress-nginx to Gateway API
A practical guide to configuring rate limiting at the Kubernetes Ingress layer and mitigating DDoS. It covers ingress-nginx annotations, a Traefik/Kong/APISIX comparison, the distributed counting problem, separating L3/L
2026-06-14 · 18 min read #ingress#rate-limiting#ddos#networking#kubernetesAPI Gateway Complete Guide 2025: Kong, Envoy, AWS API Gateway, Auth/Rate Limiting/Monitoring
Everything about API Gateways! Kong vs Envoy vs AWS API Gateway vs Traefik comparison, routing, authentication (OAuth2/JWT/API Key), rate limiting (Token Bucket/Sliding Window), request transformation, caching, monitorin
2026-04-14 · 24 min read #api-gateway#kong#envoy#aws-api-gateway#rate-limitingCloudflare AI Gateway Practical Guide: Observability, Reliability, and Cost Control for AI Traffic
A practical, current guide to Cloudflare AI Gateway as of April 12, 2026, covering observability, caching, retries, rate limiting, model fallback, and Dynamic Routing.
2026-04-12 · 5 min read #ai-platform#cloudflare#ai-gateway#observability#cachingREST API Design Best Practices 2025: Naming, Versioning, Error Handling, Pagination, Security
Everything about REST API design! Resource naming, correct HTTP method usage, status codes, error response standards, pagination (Cursor vs Offset), versioning (URL vs Header), authentication (OAuth2/JWT/API Key), OpenAP
2026-03-25 · 19 min read #rest-api#api-design#http#pagination#versioningNginx Complete Guide 2025: Reverse Proxy, Load Balancing, SSL, Caching & Security
Everything about Nginx! Event-driven architecture, reverse proxy configuration, load balancing (Round Robin/Least Conn/IP Hash), SSL/TLS setup, caching, rate limiting, WebSocket, Docker/K8s integration, and more.
2026-03-24 · 18 min read #nginx#reverse-proxy#load-balancing#ssl#cachingREST API Design Best Practices 2025: Essential Principles and Patterns Every Developer Must Know
Everything about REST API design in one post! Richardson Maturity Model, URL naming conventions, HTTP method semantics, status code strategy, pagination (Cursor vs Offset), error handling (RFC 9457), versioning, Rate Lim
2026-03-23 · 22 min read #rest-api#api-design#openapi#swagger#versioningRedis Complete Guide 2025: Caching Strategies, Data Structures, Pub/Sub, and Redis Stack
Everything about Redis! 5 data structures, caching patterns (Cache-Aside/Write-Through/Write-Behind), Pub/Sub, Redis Streams, Redis Stack (JSON/Search/TimeSeries), Lua scripting, Cluster architecture, and interview quest
2026-03-23 · 19 min read #redis#caching#data-structures#pubsub#redis-stack[Architecture] Complete Guide to Rate Limiting and API Throttling
A comprehensive guide covering rate limiting algorithms (Token Bucket, Sliding Window, etc.), Redis/Nginx/Kong implementations, LLM API cost control, and distributed rate limiting.
2026-03-20 · 18 min read #architecture#rate-limiting#api-gateway#redis#nginxComplete Guide to API Gateway Pattern: Rate Limiting, Authentication, and BFF Architecture Design
A deep dive into API Gateway patterns covering Rate Limiting algorithms (Token Bucket, Sliding Window), authentication/authorization strategies, BFF (Backend for Frontend) architecture, load balancing, circuit breakers,
2026-03-13 · 14 min read #architecture#api-gateway#rate-limiting#authentication#bffNginx Configuration Complete Guide: 15 Essential Topics from Architecture to Production Optimization
From Nginx event-driven architecture and configuration structure to reverse proxy, load balancing, SSL/TLS, caching, rate limiting, security headers, performance tuning, and health checks -- a comprehensive guide to 15 e
2026-03-01 · 33 min read #nginx#reverse-proxy#load-balancing#ssl#tls