Skip to slide
064 / 221

CH 05 · Context Engineering and Memory · 04/18

Read as one page

The context window is a budget

Every token you put in context costs money and latency, and crowds out other tokens. So treat the window as a budget to allocate, not a bucket to fill. The instinct to "give the model everything just in case" is wrong: it's expensive, it's slow, and, counterintuitively, it often degrades quality, because important details get diluted among irrelevant ones (the "lost in the middle" effect). Curate ruthlessly.

The context window is a budget
The context window is a budget

Finished this idea?

Your learning progress stays in this browser.