Skip to slide
04 / 39

CH 00 · Start Here: Benchmarks, Explained Simply · 04/06

Read as one page

Which paper is covered where

PaperYearWhat it measuresChapter
BIG-Bench (Beyond the Imitation Game)2022Breadth: a huge, diverse suite of 204 tasksChapter 1
SWE-bench2023Real-world usefulness: fixing actual software bugsChapter 2
Chatbot Arena2024Human preference: which model people actually likeChapter 3

Finished this idea?

Your learning progress stays in this browser.