How many simultaneous requests would you expect a webserver to handle

Question

I know there is no straight answer to this question - depends on specs etc. But what is the order of magnitude of simultaneous requests you'd expect a server to handle? Currently, our server starts to really slow down after more than 10 threads simultaneously running requests on it. Is that normal for an average webapp? EDIT: I am currently not in need of advice. I am not even responsible for anything related to that server. I told my boss that I think it's not normal for a simple webserver to not be able to handle more than 10 simultaneous threads, and he said I should do a quick survey.

Solution 1

You can have 1,000 concurrent requests per second, depending on what is being requested. If it's an image file, it's easy to serve it quickly without huge resources, but if you are looking at 1,000 concurrent requests to a PHP script connecting to a MySQL backend, then we're going to have to start talking about a RAID setup, lots of RAM, seperate web and db servers, or caching, though this cannot be implemented everywhere.

Perhaps you might want to tell us what you're actually running, as detailed as possible if you want any advice that might be able to help you.

Solution 2

There is no "standard" answer or even a reasonable range to give you without you providing any details. Depending upon where your server falls into the many ranges below, your mileage will vary.

The webserver could be anything from an old PC that has been re-tasked after being handed down a couple of time because "LINUX will still run on it". All the way up to a 64 way top end box with many GB of RAM, or anywhere in between.

From your post this could be just a WWW server, running any number of flavors and versions from Apache, IIS, .... or it could also be doing the application and DB work all on the same box of undetermined size.

The next piece is what are the connections doing? Grabbing a static text file or image, or running a query on a large db parsing through millions of records with a sql query of who knows what level of tuning.

If you would like some help, please post some level of detail or there is nothing useful we can give you. If not the answer is 42.

Comments

[answer42]

Somewhere between 3 and 3,000.

[gekkz]

Following up to your edit: no, it isn't usually normal, but if you still will not provide any information on what you're running and what you're running it on, it could either be normal or not normal.

[John Gardeniers]

As you're not really asking a proper question and haven't given any information on which anyone can base an answer you should at least make this a wiki article.

[olamundo]

is this site using a single server or a cluster?

[Maximus Minimus]

+1; this about sums it up. There are just so many variable factors that it's really a case of "how long is a piece of string".

[womble]

The site's a cluster, but each server has 600+ concurrent HTTP connections on average.