Skip to slide
054 / 170

CH 05 · Prompt Caching and Context Management · 06/15

Read as one page

How it works: ordering and compacting

Two small mechanisms. First, a builder that guarantees the stable prefix never changes so the cache keeps hitting. Second, a compactor that summarizes old turns when the history gets too big, while always preserving the original request and the most recent exchanges.

Finished this idea?

Your learning progress stays in this browser.