Here's an interesting example from a web server showing what happens when real memory runs out and the system starts swapping ... it can be something of a downwards spiral in terms of performance, as the majority of the resources are essentially tied up by the swapping / keeping going at all once memory is full, and a hard to recover backlog of processes can build up.
First, an example where the system is running in memory:
And this is what can happen with a slightly higher arrival rate, and / or a slightly slower processing rate such that a queue builds up:
You'll notice by comparing these two (look at the purple highlights):
1. The load average has rocketed from 0.23 jobs waiting (average in last minute) to 22.59 jobs.
2. The cpu utilisation remains low - under 10% - for user processes
3. The cpu idle time has dropped from nearly 90% to zero, with all the extra resource being burned up by device wait time - 93.6% no less.
4. Swap space has only increased slightly in its use, but every process in this machine is active and the whole thing hsa started thrashing which means a queue has built up ...
5. There's been a rise from 115 to 191 total tasks (remember that the majority of the initial 115 will be operating system background processes, so that this is a truly massive increase)
6. The process table itself is showing details of just how / where the queue has built up.
See
here for some tuning information for httpd if it's the web server that's consuming all the space (there are MySQL notes there too!)
(written 2009-02-26)
Associated topics are indexed as below, or enter http://melksh.am/nnnn for individual articles
W603 - Web and Intranet - Server Side Technologies [642] How similar are two words - (2006-03-11)
[653] Easy feed! - (2006-03-21)
[732] Where is a web site visitor browsing from - (2006-05-24)
[1020] Parallel processing in PHP - (2007-01-03)
[1031] robots.txt - a clue to hidden pages? - (2007-01-13)
[1355] .php or .html extension? Morally Static Pages - (2007-09-17)
[1365] Korn Shell scripts on the web - (2007-09-25)
[1554] Online hotel reservations - Melksham, Wiltshire (near Bath) - (2008-02-24)
[1615] PHP training courses every month - (2008-04-18)
[1749] Using server side and client side programming together - (2008-08-11)
[2282] Checking robots.txt from Python - (2009-07-12)
[3705] Django Training Courses - UK - (2012-04-23)
[3915] How does PHP work? - (2012-11-07)
[4277] Sending a message to the server and changing text on a page when a button is pressed - (2014-05-23)
G913 - Well House Consultants - Hardware and Devices [630] Hostnames spring forward - (2006-03-02)
[1281] Latercomer to the technology - (2007-07-29)
[1827] What a shock - (2008-10-08)
[1993] Load Balancing - Hardware or Software? - (2009-01-15)
[2033] Huawei D100 Wireless Router - Mobile Internet - (2009-02-10)
[2188] Camera to record where a picture was taken - (2009-05-18)
[2667] Web page to telephone calls / links using an iPhone - (2010-03-08)
[3058] MacBook Air - hardware and system review - (2010-11-17)
[3075] Change of balance, of attitude, and of work method - (2010-11-30)
[3457] Away to train - but still around by video for Melksham meetings - (2011-09-25)
[3596] Want to learn iPad and iPhone programming? Come along and learn with me for free. - (2012-01-28)
[4134] Setting up your MacBook Air as a mobile broadband router - (2013-07-07)
Some other Articles
Sharing the load between servers - httpd and TomcatInvoker and cgi servlets on Tomcat 6Train and Coach fares from London (and airports) to MelkshamWeb Site Loading - experiences and some solutions sharedEffect on server when memory runs out and swapping startsTuning httpd / the supermarket checkout comparisonWhat a difference a MySQL Index madeHow was my web site compromised?A Presentation about our company - web and PHPWhy the Pony Tail?