LLM evaluation
Your LLM-As-A-Judge Might Be Lying to You
Detect positional bias and ranking cycles in pairwise LLM judges, then use balanced comparisons to improve evaluator reliability.
4 min read
Topic
evals
4 connected articles
LLM evaluation
Stop Scoring. Start Ranking.
Learn why pairwise ranking gives more useful LLM evaluation results than numeric scoring, and how to infer relative quality.
6 min read
AI agents
Why your agent can confidently do the wrong thing
Use deterministic routing, explicit agent skills, and evals to stop AI agents from confidently selecting the wrong workflow.
5 min read
artificial intelligence
RED framework for binary AI evals. Stop debugging in the dark
Use the RED framework to make binary LLM evaluations explain their reasoning, cite evidence, and return a clear decision.
4 min read