Tag: #memory-wall
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
Cerebras Wafer-Scale Deep Dive — A Whole Model on a Single Chip
A close look at the design of the Cerebras WSE-3, a single chip carved from an entire wafer. We cover the on-chip SRAM-centric structure that routes around the memory wall, the fault-tolerant design, real-time inference
2026-06-16 · 20 min read #cerebras#wafer-scale#ai-hardware#memory-wall#inferenceThe Memory Wall and HBM — The Real Bottleneck That Divides AI Performance
In an era where compute is cheap and data movement is expensive, the real bottleneck of AI performance is memory. From the memory-wall concept to HBM generations, the roofline model and arithmetic intensity, the KV cache
2026-06-16 · 21 min read #memory-wall#hbm#bandwidth#roofline#inferenceIn-Memory Computing Principles — Computing Inside the Memory
A deep look at the principles of compute-in-memory (CIM): computing directly inside memory instead of moving data to a compute unit. We cover solving a matrix multiply in one shot with a crossbar array, the difference be
2026-06-16 · 19 min read #in-memory-computing#compute-in-memory#ai-hardware#crossbar#reram