Mitigating Thundering Herd Problems
The thundering herd problem can overwhelm backends during cache expiration.
Techniques:
- Use request coalescing (single-flight)
- Stagger cache TTLs
- Introduce jitter into TTLs
Never let many clients hammer the backend for the same data at once.
This post is licensed under CC BY 4.0 by the author.