Skip to slide
171 / 221

CH 14 · Cost, Latency, and Model Tiering · 10/14

Read as one page

Stream to mask latency

Streaming (Chapter 8) doesn't reduce real latency but transforms perceived latency. A turn that takes fifteen seconds feels responsive when the user sees reasoning, then tool activity, then the answer flowing in. Showing meaningful intermediate events ("reading contract.pdf") turns dead time into visible progress. This is a cost-free latency win and one of the best UX investments you can make.

Finished this idea?

Your learning progress stays in this browser.