Skip to slide
049 / 170

CH 05 · Prompt Caching and Context Management · 01/15

Read as one page

Chapter 4 left us with a problem: the prompt grows every turn, cost grows quadratically, and eventually the context window fills up. This chapter covers the two families of fixes that every serious harness uses. One attacks the cost curve (prompt caching). The other attacks the window ceiling (compaction and friends). They are different problems with different solutions, so keep them separate in your head.

Finished this idea?

Your learning progress stays in this browser.