Tag: #distributed-systems
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 41 posts
Consistent Hashing Complete Guide 2025: Virtual Nodes, Jump Hash, Rendezvous, and the Core Building Block of Distributed Systems
How DynamoDB, Cassandra, and Memcached minimize data movement when nodes are added or removed. A 700-line deep dive on Consistent Hashing, from first principles to virtual nodes (vnodes), Jump Hash, Rendezvous Hashing, a
2026-04-15 · 16 min read #consistent-hashing#distributed-systems#sharding#virtual-nodes#jump-hashRedis Internals & Distributed Cache — Single Thread, Data Structures, Cluster, Sentinel, RDB/AOF, Redlock, Valkey, Dragonfly Deep Dive (2025)
Why does single-threaded Redis hit 1M QPS? From String to Stream across 9 data structures, Cluster hash slots, Sentinel HA, RDB/AOF tradeoffs, Cache-Aside and Thundering Herd, the Redlock debate, the 2024 license drama a
2026-04-15 · 15 min read #redis#valkey#cache#distributed-systems#infraThe Complete Actor Model Guide 2025: Erlang OTP, Akka, Orleans, Elixir — The Real Way to Handle Millions of Concurrent Connections
How WhatsApp handled 2 million TCP connections on a single server. From the mathematical foundations of the Actor Model to Erlang OTP, Akka, and Microsoft Orleans — a 720-line deep dive into the "Let it crash" philosophy
2026-04-15 · 32 min read #actor-model#erlang#akka#orleans#elixirDistributed Systems Fundamentals Complete Guide 2025: Consensus Algorithms, Replication, Consistency Models, Fault Tolerance
Everything about distributed systems! CAP/PACELC theorem, consensus algorithms (Raft/Paxos), replication strategies (leader-follower/multi-leader/leaderless), consistency models (strong/eventual/causal), distributed cloc
2026-04-14 · 24 min read #distributed-systems#consensus#raft#paxos#replicationDistributed Systems Fundamentals: From CAP Theorem to Consensus Algorithms and Consistency Models
Everything about distributed systems! CAP/PACELC theorem, consensus algorithms (Raft/Paxos), consistency models (Strong/Eventual/Causal), replication (Leader-Follower/Multi-Leader/Leaderless), partitioning, distributed t
2026-03-23 · 21 min read #distributed-systems#cap-theorem#consensus#raft#paxosMessage Queue Showdown: Kafka vs RabbitMQ vs SQS vs Pulsar vs NATS — 2025 Decision Guide
Kafka 4.0 KRaft GA, RabbitMQ 4.2 stream filtering, Pulsar 4.1, NATS 2.11 — a complete comparison of 6 message queue systems in 2025. Architecture, benchmarks (Kafka 1M msgs/s vs RabbitMQ 50K), pricing, and Spring Boot in
2026-03-22 · 23 min read #kafka#rabbitmq#sqs#pulsar#natsAsync Processing Patterns Mastery: CQRS, Saga, Event Sourcing — Senior Backend Developer Essential Guide
Netflix processes 260M users, Uber handles petabytes of real-time data — all asynchronously. CQRS, Saga (Choreography vs Orchestration), Event Sourcing, Outbox, Idempotency, DLQ — the complete async patterns guide every
2026-03-22 · 28 min read #async#cqrs#saga-pattern#event-sourcing#event-drivenToss Bank ML Backend Engineer Study Guide: Server Architecture, ML Serving, and Career Roadmap
Complete analysis of Toss Bank ML Service Team JD. Server architecture design, large-scale traffic handling, AI model serving on K8s, MSA distributed tracing — with a 6-month study roadmap and interview preparation.
2026-03-21 · 34 min read #ml-engineering#backend#tossbank#kubernetes#pythonToss Bank Data Engineer (Kafka & Streaming) Study Guide: Tech Stack, Interview Prep, and 6-Month Roadmap
Complete analysis of Toss Bank Real-Time Data team JD. Master Kafka Broker operations, Spring Boot Kafka Client, Active-Active replication, CDC with Debezium, Flink stream processing, and ClickHouse analytics — with a 6-
2026-03-21 · 29 min read #kafka#data-engineering#tossbank#streaming#flinketcd Watch and Lease Mechanism Analysis
Deep analysis of etcd Watch and Lease mechanisms. Covers watchable store internals, event history and generation, gRPC streaming, compacted revision handling, Lease grant/revoke/keepalive, TTL implementation, and Kuberne
2026-03-20 · 4 min read #etcd#distributed-systems#open-source-internalsetcd Cluster Operations: Disaster Recovery and Performance Tuning
Covers essential etcd cluster operations including member management (add, remove, learner promotion), snapshots and backup/restore, disaster recovery (quorum loss, data corruption), and performance tuning (disk latency,
2026-03-20 · 4 min read #etcd#distributed-systems#open-source-internalsetcd Storage Engine: BoltDB and MVCC
Deep analysis of etcd storage engine internals. Covers BoltDB B+ tree structure, page types, transaction model, MVCC revision, key index, generation concepts, compaction and defragmentation, and backend batch optimizatio
2026-03-20 · 5 min read #etcd#distributed-systems#open-source-internalsetcd Architecture Internals: Raft Consensus Algorithm
A deep dive into etcd core architecture. Covers the Raft consensus algorithm (leader election, log replication, safety guarantees), internal structures like EtcdServer, raftNode, and apply loop, BoltDB-backed MVCC key-va
2026-03-20 · 6 min read #etcd#distributed-systems#open-source-internalsetcd and Kubernetes: API Server Integration Analysis
Analyzes etcd and Kubernetes API Server integration. Covers how kube-apiserver uses etcd (storage backend, codec, transformer), key hierarchy (/registry/ prefix), API Server Watch Cache (cacher, watchCache, store), etcd
2026-03-20 · 3 min read #etcd#distributed-systems#open-source-internalsFAANG System Design Interview Complete Guide
A comprehensive guide to mastering FAANG system design interviews. Covers the RESHADED framework, URL Shortener, Twitter Feed, YouTube Streaming, Chat System design examples, and company-specific question trends.
2026-03-17 · 16 min read #system-design#faang#면접#대규모시스템#distributed-systemsDistributed Systems Complete Guide: From CAP Theorem to Distributed ML Training and Kafka
A comprehensive guide to distributed systems for AI engineers, covering CAP theorem, Raft consensus, Kafka message queues, Ring-AllReduce distributed ML training, and NCCL.
2026-03-17 · 17 min read #distributed-systems#kafka#raft#pytorchdistributed#ncclObservability 2026: eBPF and OpenTelemetry Revolutionizing Monitoring
The convergence of eBPF technology and OpenTelemetry standardization is fundamentally transforming observability in 2026. Zero-instrumentation tracing, AI-powered root cause analysis, and cost-optimized stacks have becom
2026-03-16 · 7 min read #ebpf#observability#opentelemetry#cilium#distributed-systemsDistributed Lock Pattern Comparison: Redis Redlock vs ZooKeeper vs etcd — Consistency and Availability Trade-offs
Compare distributed lock implementation patterns that guarantee mutual exclusion in distributed systems. Analyze consistency, availability, and performance trade-offs through the Redis Redlock algorithm and Martin Kleppm
2026-03-12 · 17 min read #architecture#distributed-lock#redis#redlock#zookeeperCell-Based Architecture Design and Operation: Strategy to Minimize Failure Explosion Radius
A comprehensive guide covering the core principles of cell-based architecture, Bulkhead pattern, fault blast radius minimization strategy, cell routing design, AWS/Kubernetes-based implementation, Slack·DoorDash actual a
2026-03-07 · 26 min read #architecture#cell-based-architecture#blast-radius#fault-isolation#bulkhead-patternMongoDB Sharding Complete Guide: From Shard Key Design to Operational Automation
Hands-on practice with MongoDB Sharding architecture and shard key strategies. Covers Range/Hashed/Zone Sharding, chunk splitting and balancing, and operational considerations through practical exercises.
2026-03-03 · 8 min read #database#mongodb#sharding#nosql#distributed-systems