The Big Jump
We had one of those good news/bad news situations at work recently: we learned that we’d be signing a major media site that will end up bringing us something like a 50% increase in traffic (awesome news!) and that they’d start sending us traffic as soon as this week (scary!).
In an ideal world, we’d throttle the traffic from this new site and slowly ramp up, allowing us to see how our system performs under the additional load. We use AWS autoscaling for our api servers, so we have some flexibility, but there are some underlying aspects that don’t scale — we have a fixed number of MySQL instances, for example, and our log rolling has always been a pain point so there’s no guarantees whether it will scale gracefully.
Ultimately, this means that even in the best case, we’re going to see a 50% jump in initial calls, even if those calls immediately return a disable response. So that means we needed a load testing solution!