CHAPTER 00 · Start Here: Benchmarks, Explained Simply · 3 / 5
Which paper is covered where
| Paper | Year | What it measures | Chapter |
|---|
| BIG-Bench (Beyond the Imitation Game) | 2022 | Breadth: a huge, diverse suite of 204 tasks | Chapter 1 |
| SWE-bench | 2023 | Real-world usefulness: fixing actual software bugs | Chapter 2 |
| Chatbot Arena | 2024 | Human preference: which model people actually like | Chapter 3 |