Tag: #language-model
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
RWKV Architecture Deep Dive: Linear Attention RNN That Rivals Transformers
A comprehensive analysis of RWKV architecture covering the WKV attention mechanism, linear complexity advantages, comparison with Transformers and Mamba, training methodology, inference optimization, and practical deploy
2026-03-07 · 19 min read #ai-papers#rwkv#linear-attention#rnn#transformerComplete Analysis of the GPT Series Papers: The Journey from GPT-1 to GPT-4, How Language Models Changed the World
A complete generation-by-generation analysis of OpenAI GPT series. From GPT-1 unsupervised pre-training, GPT-2 zero-shot learning, GPT-3 in-context learning and scaling laws, InstructGPT RLHF, to GPT-4 multimodal capabil
2026-03-01 · 36 min read #gpt#openai#language-model#transformer#pre-training