Tag: #from-scratch
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Building LLM from Scratch: Complete Guide to Understanding GPT through Code
A complete guide to building and understanding Large Language Models from scratch. Implement a full GPT architecture in PyTorch — from tokenizer to Transformer, pretraining, and fine-tuning.
2026-03-17 · 21 min read #llm#gpt#transformer#from-scratch#deep-learningBuild Your Own GPT — Training a Language Model from Scratch with nanoGPT
Train a GPT language model from scratch using Andrej Karpathy's nanoGPT. A complete dissection of the Transformer architecture — tokenizers, Self-Attention, training loops — all with code.
2026-03-03 · 7 min read #ai#llm#gpt#nanogpt#transformer