Load Balancing - Hardware or Software?

If you're fortunate enough to be looking after a web site that's so busy that a single server can't handle all of your traffic, what should you do?

One popular approach is to use a piece of specialised hardware - a load balancer - that sits in front of your network and distributed requests to a series of machines to service the requests. Devices such as the Cisco CSS 11506 Content Services Switch (CSS11506-2AC) , for example. But such devices cost money - this one pops up for around $20,000; other may be as little as a third of that price, but still serious money.

There are some sites / applications where such a device is the best way to go - but there are other ways too if your site is too busy for one server to do everything ... but not swamped by an order of magnitude. You could, for example, run a front end system to proxy all requests through to one of a series of back end server where the real application work is done. And that front end system needs to be nothing more complex that a regular system running Apache httpd, using mod_proxy and mod_proxy_balancer to distribute traffic onwards. It's not ALWAYS going to be the solution for you, but as your site grows beyond the capacity of a single machine, it will allow for expansion without a huge investment in a specialist device and the training on and support thereof.

It's been pointed out to me that using an instance of httpd to forward all traffic leaves a single point of failure. Well - so does a hardware balancer in the scenario I have described above. Heartbeat scripts, checking device, etc, can overcome this issue and it need not be a concern.

We cover forwarding from Apache httpd on our Linus Web Server course and on our Apache / Tomcat deployment course. The first course is the one you should choose if you're forwarding to more instances of httpd, and the second if you're using httpd to front one or more Tomcat Java Application Servers.
(written 2009-01-15)

Associated topics are indexed under

G913 - Well House Consultants - Hardware and Devices
  [3596] Want to learn iPad and iPhone programming? Come along and learn with me for free. - (2012-01-28)
  [3457] Away to train - but still around by video for Melksham meetings - (2011-09-25)
  [3075] Change of balance, of attitude, and of work method - (2010-11-30)
  [3058] MacBook Air - hardware and system review - (2010-11-17)
  [2667] Web page to telephone calls / links using an iPhone - (2010-03-08)
  [2188] Camera to record where a picture was taken - (2009-05-18)
  [2055] Effect on server when memory runs out and swapping starts - (2009-02-26)
  [2033] Huawei D100 Wireless Router - Mobile Internet - (2009-02-10)
  [1827] What a shock - (2008-10-08)
  [1281] Latercomer to the technology - (2007-07-29)
  [630] Hostnames spring forward - (2006-03-02)

A690 - Web Application Deployment - Clustering and load balancing
  [3892] Distributed, Balanced and Clustered Load Sharing - the difference - (2012-10-13)
  [3339] Simplest ever proxy configuration? - (2011-06-28)
  [3293] Distributing the server load - yet ensuring that each user return to the same system (Apache httpd and Tomcat) - (2011-05-18)
  [2483] Clustering on Tomcat - (2009-10-30)
  [2482] Load balancing with sticky sessions (httpd / Tomcat) - (2009-10-29)
  [2059] Sharing the load between servers - httpd and Tomcat - (2009-02-28)
  [1995] Automated server heartbeat and health check - (2009-01-16)
  [1771] More HowTo diagrams - MySQL, Tomcat and Java - (2008-08-24)
  [1121] Sharing the load with Apache httpd and perhaps Tomcat - (2007-03-29)
  [934] Clustering, load balancing, mod_rewrite and mod_proxy - (2006-11-21)

2a8c

Back to
A good time to travel

Previous and next
or
Horse's mouth home

Forward to
tomcat-users.xml; what a difference a space made

Some other Articles

Travelling to a course - station pickups
Advise before my Apache / Tomcat course
tomcat-users.xml; what a difference a space made
Load Balancing - Hardware or Software?
A good time to travel
Rules for a King
Speaking all the languages
So sad to see you go
Melksham, Wiltshire. Town Crier Competition, 2009

4086 posts, page by page

Link to page ... 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82 at 50 posts per page

This is a page archived from The Horse's Mouth at http://www.wellho.net/horse/ - the diary and writings of Graham Ellis. Every attempt was made to provide current information at the time the page was written, but things do move forward in our business - new software releases, price changes, new techniques. Please check back via our main site for current courses, prices, versions, etc - any mention of a price in "The Horse's Mouth" cannot be taken as an offer to supply at that price.

Link to Ezine home page (for reading).
Link to Blogging home page (to add comments).

You can Add a comment or ranking to this page

Public Training Courses

Running regularly at our UK training Centre.
[Schedule] - [About] - [Book]

Like this? ??