Token

A token is the small chunk of text a model reads and writes, usually a word or a piece of a word. It is the basic unit models operate on, and it matters here because a model does a fixed, small amount of computation per token. That is precisely why writing out more tokens of reasoning (chain of thought) gives a model more room to compute. (Covered in more depth in the folder 01 glossary.)