Tag: #llm-eval
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Agent Evaluation Systems in 2026 — Inspect AI vs Promptfoo vs Phoenix vs LangSmith vs OpenAI Evals (You're Measuring the Agent, Not the Model)
LLM evals measure the model. Agent evals measure whether the model plus the harness plus the tools actually carry a task to completion. They are different problems. This is a map of the 2026 landscape — Inspect AI from U
2026-05-14 · 20 min read #agent-evaluation#inspect-ai#promptfoo#phoenix#langsmithLLM Evaluation & Observability: Eval Harness, LLM-as-Judge, Tracing, Regression Prevention (2025)
Claiming a new model "seems better" is not science. The 1 failure mode of 2025 LLM products is "not measuring". Eval harness design, LLM-as-judge pitfalls and calibration, 3-layer observability (Trace/Span/Metric), produ
2026-04-15 · 11 min read #llm-eval#observability#llm-judge#distributed-tracing#langsmith