Skip to slide
49 / 53

CH 06 · Glossary: Planning and Reasoning · 09/13

Read as one page

Emergent ability

An emergent ability is a skill a model lacks when small but suddenly shows once it crosses a certain size. Chain of thought is the classic example (Chapter 1): prompting a small model to reason step by step barely helps or even hurts, but past a scale threshold the same prompting produces a large jump. In Chapter 4, careful reasoning behaviors emerge in a different sense, appearing during reinforcement learning because they earn rewards, without anyone programming them in.


Finished this idea?

Your learning progress stays in this browser.