Tag: #data-preprocessing
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Complete Guide to Korean LLM Training Data: Hugging Face Datasets, Preprocessing, and Quality Control
Everything about LLM training data! Hugging Face datasets (types/loading/conversion), Korean data collection (crawling/synthetic/translation), preprocessing (tokenization/cleaning/dedup), Instruction Tuning formats (Alpa
2026-03-25 · 23 min read #llm#training-data#huggingface#dataset#korean-nlp