Tag: #bitnet
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
BitNet 1-bit LLM Inference Framework: Running Large Language Models on CPU
A guide to BitNet 1-bit LLM inference framework for running large language models on CPU hardware.
2026-03-15 · 25 min read #llm#bitnet#1-bit-llm#inference#cpu-deploymentBitNet Paper Analysis: The Era of 1-Bit LLMs — From Ternary Weights to CPU Inference
A comprehensive guide analyzing Microsoft Research's BitNet series (v1, b1.58, a4.8, 2B4T), covering ternary weight training principles, the bitnet.cpp inference framework, and real-world benchmarks.
2026-03-06 · 23 min read #ai-papers#bitnet#1-bit-llm#quantization#model-efficiency