When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation

This study examines how AI benchmarks lose their ability to measure progress as models increasingly max out scores. It looks at when and why saturation occurs, showing that many widely used benchmarks no longer distinguish between models. Understanding this trend matters because it affects how the field evaluates real AI capability improvements.

Sources (1)