Tag:LLM-as-judge

Articles, tutorials, and guides tagged LLM-as-judge.

Aug 17, 2026•11 min

Your LLM Judge Prefers the Longer Answer

You wired an LLM up as the grader for your evals, and now every release looks green. The problem is the judge is not scoring quality, it is scoring length, order, and answers that sound like its own. Fix the three biases that matter and calibrate the judge against human labels, so the number your pipeline gates on actually means what you think it means.

Evals

LLM-as-judge

Jul 16, 2026•10 min

LLM Evals in CI: Catch Regressions Before Your Users Do

Most teams find out a prompt change broke something from a support ticket, not from CI. Here is how to build an eval gate that scores your LLM outputs and blocks regressions before they ship.

LLM

Evals