How many servers will your service need at peak? Too few and the site slows to a crawl; too many and money is wasted. This calculator works from the peak load and the capacity of one server to give the number of servers needed for a target utilization, adds spares for redundancy, and shows the load that remains if a server fails.
How the calculation works
- Peak load (requests per second) = concurrent users × requests per user per minute ÷ 60
- Servers needed = peak load ÷ (capacity × target utilization), rounded up
- Servers to provision = servers needed + spares
- Utilization after a failure = peak load ÷ ((servers − 1) × capacity)
- Cost = servers × price per server
Example
20,000 concurrent users send 6 requests a minute each: a peak of 2,000 requests per second. One server handles 350 and should not exceed 65%, so 9 servers are needed, and 10 with one spare. With all servers running, utilization is 57.1%; after losing one, it is 63.5%. At $140 per server a month, the cost is $1,400.
Why it matters
Capacity planning avoids outages at peak times, sets the budget for hosting and shows how much redundancy is worth. The calculation also helps compare options such as fewer large servers against many small ones, since the loss of one server weighs differently on the remaining capacity.
Good to know
Real traffic is uneven, with peaks and bursts, and requests differ in cost, so the average per server is an estimate. Auto-scaling, caching and a content delivery network change the numbers. Always validate with a load test and monitoring before relying on the result. Capacity is also not the only limit: databases, network bandwidth and third-party services can saturate before the web servers do, so check the slowest component in the chain. Plan for growth by repeating the calculation with the traffic expected over the next year. This tool is for education.
Related tools
The MTBF calculator gives availability from failure and repair times, the uptime SLA calculator converts a percentage into allowed downtime, and the Little’s law calculator relates work in progress to delivery time.