Tag: #caching
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 16 posts
The Complete Guide to Database Caching Strategy: In the End, It's All Invalidation
Working from PostgreSQL 18, this guide builds caching up from the database outward: the cache layers that already exist — sharedbuffers and the OS cache — the computed cache that is a materialized view, the criteria for
2026-08-15 · 24 min read #database#postgresql#caching#performance-tuning#architectureYour Deploy Is the Load Test — What Happens When Nobody Designs the Cost of Seeding the Cache
A walk through how Canva moved the in-memory session revocation cache in its gateway from MySQL to S3. The problem was not the steady-state lookup cost but the startup cost of hundreds of pods seeding their caches simult
2026-08-09 · 8 min read #architecture#caching#s3#scalability#deploymentLLM Caching, Explained — Why Prompt Caching and Prefix Caches Save You Money
Why does a matching prompt prefix cut costs to a tenth? The answer lives in the transformer's KV cache. Because attention is causal, the Key/Value vectors of earlier tokens never change no matter what comes after — so th
2026-07-08 · 7 min read #ai#llm#caching#inference#performanceCache Invalidation, Explained
"There are two hard things in computer science: cache invalidation and naming things." This post covers why caching is so hard, strategies like TTL, write-through, write-behind, and cache-aside, the cache stampede (dogpi
2026-06-19 · 15 min read #performance#caching#systemsIn-memory Caching & KV Stores in 2026 — Redis 8 / Valkey / KeyDB / Dragonfly / Memcached / Garnet (Microsoft) / Speedb Deep Dive
A snapshot of the great in-memory cache schism that Redis kicked off in March 2024 when it switched to RSALv2/SSPL — and where the dust has settled in May 2026. Redis 8 after the relicense, the Linux Foundation Valkey fo
2026-05-16 · 24 min read #caching#key-value-store#redis#valkey#keydbCDN Complete Guide — Cache, Edge Compute, Origin Shield, and HTTP Caching Headers (2025)
Everything about CDNs — the history of edge caching since Akamai in 1998, the routing trinity of Anycast plus DNS plus GSLB, the physical anatomy of PoPs and edge servers, Cache Key design and Vary header pitfalls, HTTP
2026-04-15 · 15 min read #cdn#caching#edge-compute#cloudflare#fastlyPerformance & Core Web Vitals 2025 — LCP, CLS, INP, RUM, Image/Font/JS Optimization, Edge, CDN, HTTP/3 (S6 E6)
Performance is not a feature — it is the precondition for every feature. The full 2025 Core Web Vitals map: LCP, CLS, INP (FID successor), RUM vs synthetic, critical rendering path, JS bundle diet, image/font optimizatio
2026-04-15 · 7 min read #performance#core-web-vitals#lcp#cls#inpWeb Performance Optimization Complete Guide 2025: Core Web Vitals, LCP/INP/CLS, Loading Strategies
Everything about web performance optimization! Core Web Vitals (LCP/INP/CLS), image optimization (WebP/AVIF/lazy), bundle optimization (Tree Shaking/Code Splitting/Dynamic Import), caching strategies (Service Worker/CDN/
2026-04-14 · 22 min read #web-performance#core-web-vitals#lcp#inp#clsBackend Performance Engineering Complete Guide 2025: Profiling, Load Testing, Bottleneck Analysis, Optimization
Everything about backend performance! Profiling (CPU/Memory/I-O), load testing (k6/Artillery/Locust), bottleneck analysis (DB/Network/CPU/Memory), N+1 resolution, connection pool tuning, caching strategies (Redis/CDN/App
2026-04-14 · 21 min read #backend-performance#profiling#load-testing#optimization#k6System Design Fundamentals — Scalability, Availability, Caching, and Message Queues
Core concepts for designing large-scale systems. Horizontal/vertical scaling, load balancing, caching, message queues, database design, and the CAP theorem.
2026-04-12 · 17 min read #architecture#system-design#scalability#caching#message-queueCloudflare AI Gateway Practical Guide: Observability, Reliability, and Cost Control for AI Traffic
A practical, current guide to Cloudflare AI Gateway as of April 12, 2026, covering observability, caching, retries, rate limiting, model fallback, and Dynamic Routing.
2026-04-12 · 5 min read #ai-platform#cloudflare#ai-gateway#observability#cachingSystem Design Interview Complete Guide 2025: Scalable Architecture, Availability, and Design Patterns
Everything about system design interviews! 4-step framework, scalability (horizontal/vertical), load balancing, caching (Redis/CDN), DB sharding, CAP theorem, message queues, real-world designs (URL Shortener/Twitter/Net
2026-03-25 · 21 min read #system-design#scalability#availability#load-balancing#cachingNginx Complete Guide 2025: Reverse Proxy, Load Balancing, SSL, Caching & Security
Everything about Nginx! Event-driven architecture, reverse proxy configuration, load balancing (Round Robin/Least Conn/IP Hash), SSL/TLS setup, caching, rate limiting, WebSocket, Docker/K8s integration, and more.
2026-03-24 · 18 min read #nginx#reverse-proxy#load-balancing#ssl#cachingRedis Complete Guide 2025: Caching Strategies, Data Structures, Pub/Sub, and Redis Stack
Everything about Redis! 5 data structures, caching patterns (Cache-Aside/Write-Through/Write-Behind), Pub/Sub, Redis Streams, Redis Stack (JSON/Search/TimeSeries), Lua scripting, Cluster architecture, and interview quest
2026-03-23 · 19 min read #redis#caching#data-structures#pubsub#redis-stackComplete Guide to Redis Caching Strategies — 6 Practical Patterns from Cache-Aside to Write-Behind
Covers 6 Redis caching strategies (Cache-Aside, Read-Through, Write-Through, Write-Behind, Refresh-Ahead, and Cache Stampede prevention) with code examples.
2026-03-03 · 9 min read #database#redis#caching#cache-aside#write-throughNginx Configuration Complete Guide: 15 Essential Topics from Architecture to Production Optimization
From Nginx event-driven architecture and configuration structure to reverse proxy, load balancing, SSL/TLS, caching, rate limiting, security headers, performance tuning, and health checks -- a comprehensive guide to 15 e
2026-03-01 · 33 min read #nginx#reverse-proxy#load-balancing#ssl#tls