Distributed systems are composed of multiple systems that are wired together to provide a specific functionality. Systems that operate at a cloud scale can get expected or unexpected surges of traffic from one or multiple callers and are expected to perform in a predictable manner.
This article analyzes the effects of traffic surges on a distributed system. It lays out a detailed breakdown of how every layer is affected and provides mechanisms to achieve predictable performance during traffic surges.
