Tag: #instruction-tuning

한국어English日本語中文

← All posts

• Training Vision LLMs — How to Teach Input and Output

  A vision-language model is trained in stages, from alignment pretraining to instruction fine-tuning. We organize what gets taught and how, from the angle of the training pipeline: vision encoder freezing strategy, data c

  2026-06-26 · 17 min read #mlops#vision-language-model#multimodal#training#instruction-tuning

• Complete Guide to Korean LLM Training Data: Hugging Face Datasets, Preprocessing, and Quality Control

  Everything about LLM training data! Hugging Face datasets (types/loading/conversion), Korean data collection (crawling/synthetic/translation), preprocessing (tokenization/cleaning/dedup), Instruction Tuning formats (Alpa

  2026-03-25 · 23 min read #llm#training-data#huggingface#dataset#korean-nlp

• LLM Fine-tuning Practical Guide: Efficient Model Adaptation with LoRA, QLoRA, and PEFT

  A comprehensive guide to LLM fine-tuning theory and practice. Covers LoRA low-rank decomposition principles, QLoRA 4-bit quantization techniques, PEFT library usage, dataset preparation strategies, and hyperparameter tun

  2026-03-13 · 10 min read #llm#fine-tuning#lora#qlora#peft

• Complete Analysis of the GPT Series Papers: The Journey from GPT-1 to GPT-4, How Language Models Changed the World

  A complete generation-by-generation analysis of OpenAI GPT series. From GPT-1 unsupervised pre-training, GPT-2 zero-shot learning, GPT-3 in-context learning and scaling laws, InstructGPT RLHF, to GPT-4 multimodal capabil

  2026-03-01 · 36 min read #gpt#openai#language-model#transformer#pre-training