Tag: #open-source-llm
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 10 posts
Choosing Speech Models: Practical Criteria for STT and TTS
Unlike text models, speech models are chosen after the language coverage, audio length constraints, real-time requirement, and diarization need are already fixed. This post lays out the parameters, licenses, language cov
2026-08-12 · 7 min read #ai#huggingface#open-source-llm#speech-to-text#text-to-speechChoosing Open Text Generation Models by Size Class
When picking an open text generation model, size is not a quality tier — it is a deployment constraint. This post splits the field into on-device small, single-GPU mid, and server-class large, listing the parameters, con
2026-08-12 · 7 min read #ai#llm#huggingface#open-source-llm#text-generationOpen Models That Support Korean, and the Cost of Tokenization
A line saying a model supports Korean means it processes the language, not that it is good at it. This post lays out the card values read on 2026-08-12 for Korean-focused, bilingual, and multilingual open models, explain
2026-08-12 · 6 min read #ai#llm#huggingface#open-source-llm#korean-nlpLicenses and Deployment: Reading the Types and Verifying Quantized Builds
The short identifier in an open model license field is a table of contents; the actual terms live in the full text. This post organizes the license types actually encountered on 2026-08-12, what community licenses and no
2026-08-12 · 7 min read #ai#llm#huggingface#open-source-llm#licenseChoosing Code Models: Completion vs Chat, FIM, and Licenses
Code models come in two different products: the completion model that fills the cursor position inside an editor, and the conversational model that answers questions. This post organizes the parameters, context, fill-in-
2026-08-12 · 7 min read #ai#llm#huggingface#open-source-llm#code-llmVision and Multimodal: Image Understanding, OCR, and VLMs
Vision models are not one category. Conversational VLMs, dedicated OCR, document structuring, and image retrieval embeddings are different objects and do not substitute for one another. This post organizes the card value
2026-08-12 · 7 min read #ai#huggingface#open-source-llm#vision-language-model#ocrHow to Read a Hugging Face Model Card: What to Trust and What to Doubt
Six fields on a Hugging Face model card actually carry decision weight: license, parameter count, context length, intended use, limitations, and training data. This post explains what each field means and what it hides,
2026-08-12 · 7 min read #ai#llm#huggingface#open-source-llm#model-cardEmbeddings and Rerankers: What Actually Matters in RAG
What decides your embedding model in a RAG build is not a leaderboard rank but dimensionality, maximum input length, prefix conventions, multilingual coverage, and the division of labor with a reranker. This post lays ou
2026-08-12 · 7 min read #ai#llm#huggingface#open-source-llm#embeddingOpen-Source LLMs 2026 Deep Dive - Llama 4 · DeepSeek V3 + R1 · Qwen 3 · Mistral Large 2 · Phi-4 · Gemma 3 · Falcon 3
In spring 2026, open-source LLMs are no longer the shadow of closed models. Meta Llama 4 (Scout 109B, Maverick 400B MoE, Behemoth 2T), Llama 3.3 70B as the last dense baseline, DeepSeek V3 671B MoE and the R1 reasoning m
2026-05-16 · 32 min read #open-source-llm#llama-4#deepseek#qwen#mistralThe Open Source LLM Revolution 2026: Llama 4, Gemma 3, and Mistral Large 3 Reshape the Industry
In early 2026, Meta's Llama 4, Google's Gemma 3, and Mistral's Large 3 launches nearly simultaneously revolutionized the open-source language model market. Open-source models now demonstrate performance parity with propr
2026-03-17 · 5 min read #open-source-llm#llama-4#gemma-3#mistral-large-3#ai