Tag: #regression-testing
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
Harness Fingerprints and Versioning — Making Unrecorded Changes Traceable
The success rate moved with no prompt commit and no model change — so what do you roll back? Part 7 of the harness engineering series covers the harness fingerprint: a single normalized hash summarizing every decision th
2026-08-12 · 5 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트Building an Eval Set for Your Own Service — From Traffic Collection to Statistical Significance
Public benchmarks cannot measure your problem for you, because the input distribution, the definition of a correct answer, and the cost structure of failure are all different. This post walks through, with real code, how
2026-08-02 · 23 min read #llm-evaluation#eval-set#rubric#statistics#regression-testingHow to Stop Evaluating LLMs on Vibes — Sample Size, Judge Bias, and CI Regression Tests
A team that edits a prompt and ships on "it seems better now" has no way to see the regressions quietly piling up. This post splits evaluation into four layers — assertions, golden datasets, LLM-as-judge, and human revie
2026-07-26 · 12 min read #llm#evaluation#llm-as-judge#statistics#regression-testing