Tag: #model-compression
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
Knowledge Distillation Complete Guide: Model Compression and Lightweight Techniques
A complete guide to mastering knowledge distillation and model compression. Covers Teacher-Student learning, intermediate-layer distillation, relation-based distillation, structured pruning, weight sharing, and neural ar
2026-03-17 · 22 min read #knowledge-distillation#model-compression#pruning#deep-learning#aiDeep Learning Model Quantization Complete Guide: Master INT8, INT4, GPTQ, AWQ, GGUF
A comprehensive guide to mastering deep learning model quantization. Understand the principles from FP32 to INT8 and INT4 quantization, and master GPTQ, AWQ, GGUF, bitsandbytes, AutoGPTQ, and llama.cpp through practical
2026-03-17 · 23 min read #quantization#model-compression#gptq#awq#ggufLLM Quantization Practical Guide: GPTQ, AWQ, GGUF Format Comparison and Precision-Performance Trade-offs
A practical guide to LLM quantization covering GPTQ, AWQ, and GGUF format comparison with precision-performance trade-off analysis.
2026-03-14 · 21 min read #llm#quantization#gptq#awq#gguf