Blog
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3517 posts
#2026-03 765#english 592#culture 264#deep-dive 254#kubernetes 247#career 229#ai 216#llm 208#devops 193#2026-04 146#security 141#database 114#observability 113#communication 109#history 107#architecture 100#productivity 96#finance 88#economy 84#mindset 81#psychology 80#ai-papers 79#food 78#it 78#travel 78#deep-learning 77#japanese 77#networking 77#performance 72#business-travel 70#linux 70#gpu 69#ai-agent 66#cs-fundamentals 63#postgresql 60#rag 58#self-improvement 55#learning 53#mlops 53#ai-platform 51
Multimodal Tokenization and Fusion — Turning Images and Audio Into Tokens
A deep look at how images, audio, and video become tokens and get woven into one sequence with text. We cover patch and VQ image tokenization, discrete-codec audio tokenization, frame sampling, interleaving and separator
2026-06-26 · 14 min read #llm#multimodal#tokenization#vision-language#q-formerThe KV Cache and PagedAttention — Everything About Inference Memory
A deep dive into the KV cache, the single biggest consumer of memory in LLM inference. We cover what the KV cache is and why it eats memory, the memory arithmetic and fragmentation problem, PagedAttention block managemen
2026-06-26 · 12 min read #kv-cache#paged-attention#inference#gpu-memory#quantizationMultimodal AI Training Methods — Many Senses in One Model
A walkthrough of how multimodal AI learns to handle images, text, audio, and video in a single model. We cover modality alignment and contrastive learning, fusion strategies, shared embedding spaces, pretraining and fine
2026-06-26 · 15 min read #ai-papers#multimodal#clip#vision-language#contrastive-learningRust Macros: Declarative vs Procedural (derive)
Rust macros are a metaprogramming tool that generates code at compile time. This post distinguishes pattern-based declarative macros (macrorules!) from procedural macros (derive, attribute, function-like) that receive co
2026-06-26 · 10 min read #rust#macros#metaprogrammingPRs and Commit Messages That Get Merged Fast
PRs that get reviewed quickly and merged fast have things in common. Small, single-purpose PRs, Conventional Commits, the "why" in the commit body rather than just the "what", a self-review first, a PR description with c
2026-06-26 · 8 min read #git#code-review#collaborationBeyond OCR — OCR-free Document Understanding and Unified Models
A traditional OCR pipeline splits into detection, recognition, and layout stages, but errors accumulate. We organize the shift in document AI: Donut-style and VLM-based OCR-free document understanding, high-resolution an
2026-06-26 · 20 min read #ai-papers#ocr-free#document-understanding#multimodal#donutCode Review as Communication: Feedback Without Friction
Code review is a technical activity for catching defects, but it is also a conversation between two people. This post covers framing critique at the code rather than the person, using conventional comments to separate ni
2026-06-26 · 14 min read #code-review#communication#engineeringThe HTTP QUERY Method — A New Verb for an Old REST Dilemma
GET cannot carry a request body and POST is semantically wrong for search. This article explores the HTTP QUERY method that resolves this long-standing dilemma, covering its motivation, semantics, and practical adoption.
2026-06-25 · 14 min read #http#query-method#rest#api-design#rfcDNS in Depth — The World of Name Resolution That Free Hosting Revealed
DNS is trending again. From recursion and authority to caching and TTL, global Anycast distribution, DNSSEC, and DoH/DoT, we take a deep look at the entire process of name resolution. As free DNS hosting becomes the norm
2026-06-25 · 22 min read #network#dns#anycast#dnssec#dohThe Rise of AI Code Review Tools — What to Delegate and What Humans Should Still See
AI code review tools are spreading fast. We separate the defects AI catches well from the areas humans must still own, and cover CI integration, an adoption checklist, and a critical perspective.
2026-06-25 · 16 min read #devops#code-review#ai-tools#developer-experience#ci-cdHunting Bugs with AI — The Era of Automated Security Research
Cases of AI automatically probing APIs at scale to uncover vulnerabilities are on the rise. From how fuzzing, differential analysis, and LLM-assisted triage work, to the asymmetry of attackers also using AI, the implicat
2026-06-25 · 20 min read #devops#security#ai#bug-bounty#fuzzingTechnical Overreach and Scope — Lessons from Carmacks Retrospective
Using John Carmacks publicly shared Quake retrospective as a starting point, we draw out the technical ambition and organizational challenges of early game development as general lessons. We cover the value of choosing s
2026-06-25 · 25 min read #culture#engineering#scope#technical-debt#teamThe Joy of Understanding — Why Deep Understanding Still Matters in the LLM Era
Search and LLMs give fast answers, but deep understanding gives control and ownership. We cover the value of seeing beneath abstractions, the stance of not being dragged by your tools, the difference understanding makes
2026-06-25 · 24 min read #culture#learning#craftsmanship#understanding#engineeringOpinionated Tools — gofmt, gofumpt, and the Politics of Code Style
Why was code formatting ever a subject of debate, and how did gofmt end it? We compare gofmt with the stricter gofumpt, and contrast them with tools from other languages like prettier and black, taking a deep look at how
2026-06-25 · 21 min read #compiler#go#gofmt#gofumpt#formatterThe Rise of the Agentic Web — auth.md and the Era of AI Signing Up On Your Behalf
AI agents signing up for and acting on services on behalf of users — the agentic web — is rapidly becoming reality. We examine the idea of domain-root standards like the auth.md proposal that emerged in the WorkOS contex
2026-06-25 · 21 min read #ai#agent#authentication#oauth#web-standardsCode Becomes the Agents Execution Substrate: A Code-as-Harness View
This post reframes code not as an LLMs final artifact but as the execution harness through which an agent interacts with its environment. Centered on verification loops, tool calling, and execution feedback, it lays out
2026-06-25 · 19 min read #ai#agentic-coding#llm-agents#tool-calling#reactBuilding a Kubernetes Operator in Rust (kube-rs)
A Kubernetes Operator is a controller that encodes operational knowledge as code. This post covers the Operator pattern (CRD + controller + reconcile loop) from first principles, then how to build a real operator with ku
2026-06-25 · 12 min read #rust#kubernetes#operator#kube-rsRate Limiting Algorithms, Explained: Fixed Window, Sliding Window, Token Bucket, and Leaky Bucket
A side-by-side tour of the main rate limiting algorithms — fixed window, sliding window log and counter, token bucket, and leaky bucket. How each handles bursts, how to implement rate limiting across a distributed fleet
2026-06-25 · 11 min read #systems#api#reliabilityWhat Distributed Systems Taught Me About Relationships
Retries with backoff, timeouts, heartbeats, consistency models, backpressure, graceful degradation, idempotency, the Two Generals Problem, and trust as a cache with a TTL. The same problems that make distributed systems
2026-06-25 · 13 min read #engineering#relationships#fun#distributed-systemsA Tour of the Rust Ecosystem: Great Crates and Projects
Rust's real power lies as much in its ecosystem as in the language itself. This post takes a tour of the landscape, starting with cargo and crates.io and moving through the flagship crates: serde and tokio, rayon for dat
2026-06-24 · 9 min read #rust#ecosystem#crates