Post

Mitigating Thundering Herd Problems

The thundering herd problem can overwhelm backends during cache expiration.

Techniques:

  • Use request coalescing (single-flight)
  • Stagger cache TTLs
  • Introduce jitter into TTLs

Never let many clients hammer the backend for the same data at once.

This post is licensed under CC BY 4.0 by the author.