Skip to slide
149 / 221

CH 13 · Reliability: Retries, Idempotency, and Failure Handling · 01/13

Read as one page

Reliability: Retries, Idempotency, and Failure Handling

Model APIs time out and tools go flaky, so reliable agents expect failure. Covers backoff retries and resuming interrupted work.

13 slides · 5 min read

Contour map for Reliability: Retries, Idempotency, and Failure Handling

In this chapter

  1. 01Assume everything fails
  2. 02Defensive parsing of model output
  3. 03Retries with backoff
  4. 04Idempotency for actions with side effects
  5. 05Persist progress for resumability
  6. 06Graceful degradation
  7. 07Failing within a stream
  8. 08Timeouts and circuit breakers
  9. 09Caching as reliability
  10. 10Bound the agent's own runaway behavior
  11. 11Observability closes the loop
  12. 12The reliability checklist

Agents are built on components that fail routinely: model APIs time out or rate-limit, tools hit flaky external services, the model itself produces malformed output. A reliable agent isn't one where nothing fails; it's one that expects failure and degrades gracefully. This chapter covers the patterns that make agents dependable.

Finished this idea?

Your learning progress stays in this browser.