Evaluation
Benchmarks, metrics, and evaluation methodology.
LLM Benchmarks
LLM benchmarks are standardized test suites designed to measure specific capabilities of language models, forming the primary (if imperfect) basis for comparing models across the industry.
Traditional NLP Metrics: BLEU, ROUGE & BERTScore
BLEU, ROUGE, and BERTScore are automated text evaluation metrics that compare generated text against reference text using n-gram overlap (BLEU, ROUGE) or contextual embedding similarity (BERTScore), each with distinct strengths and well-known limitations.
Perplexity
Perplexity measures how “surprised” a language model is by new text, serving as the most fundamental intrinsic metric for evaluating how well a model has learned the statistical patterns of language.
Human Evaluation & Benchmark Contamination
Human evaluation remains the gold standard for assessing LLM quality through methods like pairwise preference and ELO ranking, but its validity – along with all benchmark results – is increasingly threatened by benchmark contamination, where test data leaks into training sets.
LLM-as-a-Judge
LLM-as-a-Judge uses a strong language model to evaluate the outputs of other language models, offering a scalable and cost-effective alternative to human evaluation while introducing its own set of systematic biases.
Chatbot Arena and ELO-Based Evaluation
Chatbot Arena (by LMSYS) is a crowdsourced evaluation platform where real users compare anonymous LLM responses head-to-head, with results aggregated using Bradley-Terry models (a generalization of ELO ratings from chess) to produce what has become the most trusted and influential public ranking of LLM quality – demonstrating that human preference evaluation captures quality dimensions that automated benchmarks cannot.
Benchmark Contamination Detection
Benchmark contamination detection is the set of techniques used to determine whether an LLM was trained on data from benchmark test sets – using methods ranging from n-gram overlap analysis and canary string insertion to membership inference attacks and perplexity-based statistical tests – because contamination silently inflates benchmark scores and undermines the integrity of the entire model evaluation ecosystem.