Tag: #harness-engineering
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 9 posts
Growing into a Harness Engineer — Why the Job Exists and What to Practice
The title harness engineer is still rare in job postings, but the work already exists in every team shipping agents. The final part 8 of the harness engineering series covers why this job emerged, how existing software s
2026-08-12 · 4 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트Loop Design — Between Infinite Loops and Giving Up Early
Agent loops fail in two directions: the infinite loop that repeats the same call dozens of times, and the early stop that quits at the first obstacle. Part 4 of the harness engineering series covers retry caps, the three
2026-08-12 · 5 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트The Evaluator Bottleneck — A Weak Grader Caps the Whole System
If the score does not move no matter how much you fix the harness, the bottleneck may be the evaluator, not the harness. You cannot select for a quality you cannot measure, which is why a weak grader becomes the ceiling
2026-08-12 · 5 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트Reward Hacking — The Metric Rises While the Task Fails
If the cheapest way for an agent to pass the tests is to edit the tests, the agent will edit the tests. Reward hacking is not a bug; it is the exact optimization of the goal we wrote down. Part 6 of the harness engineeri
2026-08-12 · 5 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트Tool Surface Design — One Schema Line Moves the Success Rate
Adding more tools and watching the agent success rate drop is not rare. The tool surface is the agent interface, and the names, descriptions, parameters, failure returns, and response sizes are all design material. Part
2026-08-12 · 5 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트The Context Budget — Design Is What You Leave Out, Not What You Put In
The context window still has room, yet agent accuracy is dropping. Context is a finite attention budget, and tool schemas spend it too. Part 2 of the harness engineering series covers turning prompt accumulation into a p
2026-08-12 · 6 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트Harness Fingerprints and Versioning — Making Unrecorded Changes Traceable
The success rate moved with no prompt commit and no model change — so what do you roll back? Part 7 of the harness engineering series covers the harness fingerprint: a single normalized hash summarizing every decision th
2026-08-12 · 5 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트What Is Harness Engineering — The Model Is a Fixed Input; What You Ship Is Everything Around It
Two teams use the same model, so why do their agents perform so differently? For most teams the model is a fixed input, and what actually ships is the harness around it: the tool surface, the failure return format, the l
2026-08-12 · 6 min read #llm#agent#harness-engineering#하네스엔지니어링#AI에이전트A Harness Is Not Configuration but a Deployable — The Real Bottleneck of the Self-Improvement Loop
The harness engineering post Lilian Weng published in July 2026 gives a name to the whole system wrapped around a model and treats it as a single engineering object. Rather than restating that definition, this post cover
2026-08-09 · 7 min read #llm#agent#harness-engineering#context-engineering#evaluation