Tag: #mamba
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 6 posts
LLM Landmark Papers Roundup 2026 - Transformer / Scaling Laws / Flash Attention / Mamba / DeepSeek-R1 / Titans Deep Dive
From the 2017 Attention Is All You Need paper to 2026 Titans and DeepSeek-R1, a thematic roundup of the 50+ landmark papers that built the LLM era. Transformer, BERT, GPT 1-3, Scaling Laws, Chinchilla, InstructGPT, PaLM,
2026-05-16 · 21 min read #llm-papers#transformer#scaling-laws#flash-attention#mambaFoundation Model Architectures 2026 — Beyond the Transformer / Mamba 2 / Hyena / RWKV / RetNet / Griffin / Jamba / xLSTM / TTT / DiT / MoE / Flash Attention 3 Deep Dive
In 2026 the foundation-model world is no longer Transformer-only. Vaswani 2017 "Attention is All You Need" remains the standard, but next to it stand state-space models (Mamba, Mamba 2), the linear-RNN renaissance (RWKV,
2026-05-16 · 22 min read #foundation-models#transformer#attention-is-all-you-need#vaswani#mambaMamba and State Space Models Complete Guide: Beyond Transformers
A complete guide to understanding Mamba and State Space Models (SSMs). We deeply analyze S4, H3, and Mamba 1/2 architectures that solve the quadratic complexity problem of Transformers, along with hybrid models like Mamb
2026-03-17 · 20 min read #mamba#state-space-model#ssm#deep-learning#sequence-modelingMamba and State Space Model Paper Deep Dive: Transformer Alternative Architectures from Selective SSM to Mamba-2
A comprehensive analysis of the SSM architecture covering the optional State Space Model mechanism of the Mamba paper, the development process from S4 to Mamba-2, the pros and cons of linear time complexity compared to T
2026-03-07 · 30 min read #ai-papers#mamba#state-space-model#ssm#transformerMamba Paper Review: Going Beyond Transformers with Selective State Space Models
An in-depth review of the Mamba (Selective State Space Models) paper. Analyzing the evolution from S4 to Mamba, the Selective Scan mechanism, Hardware-Aware algorithms, and Mamba-2 State Space Duality with code examples.
2026-03-02 · 8 min read #mamba#state-space-model#ssm#transformer#linear-attentionMamba: Linear-Time Sequence Modeling with Selective State Spaces — Paper Analysis
A deep dive into the Mamba architecture, a promising alternative to Transformers. We explore the core idea behind Selective State Space Models, the hardware-aware algorithm, and experimental results along with code.
2026-03-02 · 7 min read #ai-papers#mamba#ssm#state-space-model#transformer