Skip to slide
184 / 221

CH 16 · Scaling and Infrastructure · 01/11

Read as one page

Scaling and Infrastructure

A demo runs on one laptop; a product serves many users with long-lived streams. Covers statelessness and upstream rate limits.

11 slides · 5 min read

Contour map for Scaling and Infrastructure

In this chapter

  1. 01What's different about scaling an agent
  2. 02Statelessness: the foundation
  3. 03Handling streaming connections at scale
  4. 04Move heavy work off the request path
  5. 05Respect and manage upstream rate limits
  6. 06Data tier scaling
  7. 07Caching tiers
  8. 08Don't over-build early
  9. 09Deployment and operational basics
  10. 10The scaling mindset

A demo runs on one process on one laptop. A product serves many users concurrently, holds long-lived streaming connections, processes files, and calls slow external APIs, all without falling over. This chapter covers the infrastructure patterns that take an agent from "works for me" to "works for everyone," and where the bottlenecks actually are.

Finished this idea?

Your learning progress stays in this browser.