Why it mattered

Chatbot Arena filled the one quadrant the other benchmarks could not reach: live questions judged by human preference. Because its questions are always fresh and never published as a fixed answer key, it is far harder to game by memorization than a static test. It quickly became one of the most cited LLM leaderboards in the field, watched closely by the major model developers, precisely because it measures the thing users ultimately care about, which model is nicer to actually use. It also showed that rigorous statistics and noisy human voting are not enemies: with the right methods, a crowd can produce a ranking as credible as expert review.