Keynote article ...
Clustering on Tomcat
Subject: Clustering, using Apache http server (version 2.2.14 in my example) with mod_proxy_balancer as the front load splitter and Apache Tomcat 6.0.20 as the replicated application engine. [[Tip should also work for other recent 2.2.x and 6.0.x versions]]
Background
This is a follow on article from Load balancing with sticky sessions (httpd / Tomcat), where I looked at sharing out the application work between a number instances of Tomcat from an Apache http server (httpd) that did the bookkeeping. In a nutshell, the Apache http server sent new arrivals to a 'random' Tomcat, and then used sticky sessions so that - when a visitor came back for their subsequent visit in the same series of accesses - they would always talk to the same Tomcat and could continue their conversation with the server having full knowledge of the position to date.
The balancer alone is a good solution as far as it goes but:
• What happens if the Tomcat that has been stuck to goes out of service?
• What happens if you have such a lot of traffic that you need to replicate your httpd front end?
• What happens if your httpd fails?
• What is you don't actually want to use sessions, but still need what appears to be a single Tomcat?
One possible option to addressing some of these is to use the clustering capability of Tomcat, which I'll describe below. But you should first consider if you really need the extra step:
(a) can I accept that a session will be lost on the rare occasions that a Tomcat goes offline?
(b) is writing to a backend database going to preserve sufficient information anyway?
and if the answer to either is "yes", you probably do NOT need to cluster.
How does clustering work?
You run your web application on a series of identical (or rather "near identical" - the IP address will differ!) servers. With clustering turned on, each of the servers in the cluster is broadcasting (via multicast) any changes made in sessions, cookies, etc to any other listening cluster members on that same multicast address. So that when a visitor comes back for his / her next access, all the machines know what's been going on and can knowledgeably handle the request, even if the original machine isn't available.
You can turn clustering on in Apache Tomcat 6.0.20 simply by uncommenting the line in the default server.xml file that relates to it:
<Cluster className = "org.apache.catalina.ha.tcp.SimpleTcpCluster"/>
and restating your Tomcat. Older versions of Tomcat (such as 5.5) had a long configuration section listing the ports, replication time, IP addresses to use, trigger files all of which are important but none of which actually needs to be changed from default in the current release that's the target of this article.
Once you have turned clustering on (yes, it's now that simple), your machines will be communicating ... it's rather like starting a rumor in an office - before you know it, EVERYONE who's around has heard the rumor.
Clustering with the balancer
If you have already implemented balancing with sticky sessions (as covered in the preceeding article), turning on clustering will cause the data to be shared around. Most of the time the data passed around will not be used - it will ONLY form a backup of the session, to be used if the balancer is unable to reach the sticky machine because it has done down or been taken out of service.
With sticky sessions activated, even a second front-end Apache http server won't cause a switch from one Tomcat to another unless a fail-over occurs, as the jvmroute is a part of the cookie so either (any) of the httpd front ends will correctly forward to the original Tomcat. And if you have an intelligent hardware load balancer, that too will be able to forward consistently and the the clustering will remain merely as a backup.
If you disable sticky sessions on your balancer, the metrics will change. Forwarding will now be at shared to each of the Tomcats in the balanced group / cluster group (take care that all members of the balance group are included in the cluster!) and so the visitor will get to a differnt back end box each time. But that's now perfectly fine, as they're sharing the data between them so will all know about the originator.
Testing if your cluster is working
Ironically, clustering and balancing is designed to be transparent, so how do you test whether it's working?
My first simple 'trick' is to change the background colour of the pages returned from each cluster member so that "if it's orange it must be Holt" and "if it's blue it must be Chippenham" (our servers are names after local towns and villages!). Going a little further, you can edit your servlet / JSP to return the name of the current host. In Java, the following line:
String myname = InetAddress.getLocalHost().getHostName();
will return you the local name of your computer, so that you can then echo the name.
On last Tuesday's course, I took our sample "Barman" script that remembers how many drinks you've had in a session (visit counter!) and extended it into a "Pub Watch" script, where each of the barman communicates with his colleagues in neighboring pubs to keep track of who's out on the town, and how much they have had to drink in each establishment.
If you click on the links in the previous paragraph, you can download the source code for "Barman" and "PubWatch" and try the code out for yourself. Using the balancer manage that I introduced at the end of yesterday's article, you can open and close individual pubs and see how their customers go elsewhere for their next drink, and you can turn sticky sessions off in the balancer and see how faithful customers will then hit the road and go to a different pub each time for their next drink.
Some notes on clustering
1. The machines in the cluster communicate through multicast, so must be on the same subnet.
2. It's a good idea for the subnet you use to have plenty of capacity if your environment is busy, and for it to be firmly behind a strong firewall from your own company's general user traffic, let alone the Internet
3. If you have multiple Tomcat clusters on the same subnet, you'll need to configure one of the clusters away from the default settings - otherwise they'll end up as being one big cluster (you'll find the word 'tribe' creaping in here!)
At present, we mention clustering on our public deploying apache httpd and Tomcat course. Only a small proportion of our delegate want to go 'that far', and for newcomers who hadn't done any web server work when they first came along a couple of days earlier, it would be just too much for the one session.
An extra day on the end of a Tomcat course, coverage in a private course, or a special session set up for the purpose ... all are possible to help you learn how clustering and balancing work. We'll have a network of computers set aside at our training centre for the purpose of setting up a test case, experimenting with configurations, seeing what happens when machines are switched on and off. Something you wouldn't dare so with your own production environment, and might be reluctant to do even on your development of test networks (that's even assuming that you do HAVE multiple machines at the development or test level).
(this article written on 2009-10-30) |
Other articles ...
[3019] Apache httpd Server Status - monitoring your server
[3018] Tuning Apache httpd and Tomcat to work well together
[3015] Logging the performance of the Apache httpd web server
[2900] Redirecting a page - silent, temporary or permanent?
[2768] Carrying a long URL around - looking for memorable shorts
[2753] You do not just fly - that is just part of the journey
[2728] Redirecting a home page using mod_rewrite
[2596] Http protocol - what does a web server send
[2552] Web site traffic - real users, or just noise?
[2482] Load balancing with sticky sessions (httpd / Tomcat)
[2355] See this page in French
[2325] Apache, Tomcat, mod_proxy
[2273] Three recent questions on Tomcat Convertors
[2272] Monitoring and loading tools for testing Apache Tomcat
[2186] An FAQ on the Apache httpd and Apache Tomcat web servers, and on using them together
[2184] Choosing the right version of Java and Tomcat
[2163] CATALINA_OPTS v JAVA_OPTS - What is the difference?
[2120] Java on the Web Server - course for delegates with some prior Java experience
[2096] Where is my new Apache httpd installed
[2094] If you have a spelling mistake in your URL / page name
[2088] Changing the 404 - file not found - page in Tomcat
[2082] Jmeter - a first test case
[2081] Connecting jconsole remotely - the principles
[2080] Using ApacheBench and jconsole to test and monitor Tomcat
[2079] Java - Memory Allocation and garbage collection
[2077] Why put Apache httpd in front of Apache Tomcat
[2072] Copyright, Portability and other nontechnical web site issues
[2063] Internal Dummy Connections on Apache httpd
[2062] Virtual hosting and mod_proxy forwarding of different domains (httpd)
[2061] Tomcat 6 - Annotated Sample Configuration Files
[2060] Database connection Pooling, SSL, and command line deployment - httpd and Tomcat
[2059] Sharing the load between servers - httpd and Tomcat
[2055] Effect on server when memory runs out and swapping starts
[2054] Tuning httpd / the supermarket checkout comparison
[2039] The Invoker
[2038] Sticky Sessions with mod_jk (httpd to Tomcat)
[2016] Apache httpd and Apache Tomcat miscellany
[1994] tomcat-users.xml; what a difference a space made
[1974] Moving a directory on your web site
[1969] Search Engines. Getting the right pages seen.
[1945] Summary - Apache httpd build on Linux
[1944] Forwarding session and cookie requests from httpd to Tomcat
[1943] Port and Glasses
[1941] Server - Service - Engine - Host, Tomcat
[1940] URL rewriting with front and back servers
[1939] mod_proxy_ajp and mod_proxy_balancer examples
[1901] XML, HTML, XHTML and more
[1899] Virtual Hosting under Tomcat - an example
[1896] Virtual Hosts and Virtual Servers
[1796] libwww-perl and Indy Library in your server logs?
[1767] mod_proxy and mod_proxy_ajp - httpd
[1762] WEB-INF (Tomcat) and .htaccess (httpd)
[1761] Logging Cookies with the Apache httpd web server
[1749] Using server side and client side programming together
[1718] Increasing Java Virtual Machine memory for Tomcat
[1707] Configuring Apache httpd
[1687] Virtual Hosting on Apache httpd - a primer example
[1686] FTP - how not to corrupt data (binary v ascii)
[1656] Be careful of misreading server statistics
[1636] What to do if the Home Page is missing
[1619] User and Group settings for Apache httpd web server
[1615] PHP training courses every month
[1593] Keep the client experience easy - single server contact point
[1566] Strange behaviour of web directory requests without a trailing slash
[1564] Default file (MiMe types) for Apache httpd and Apache Tomcat
[1554] Online hotel reservations - Melksham, Wiltshire (near Bath)
[1553] Automatic startup and shutdown of Tomcat
[1552] Extra public classes in deploying Apache httpd and Tomcat
[1551] Which modules are loaded in my Apache httpd
[1503] Web page (http) error status 405
[1486] Does anyone understand Lithuanian?
[1449] Upgrade Mac OSX to Leopard, Web Server Apache httpd config lost
[1383] Monitoring mod_jk and how it is load balancing
[1378] Etag in http headers - what is it?
[1377] Load Balancing with Apache mod_jk (httpd/Tomcat)
[1376] Choosing between mod_proxy and mod_rewrite
[1370] Apache Tomcat Performance Tuning
[1365] Korn Shell scripts on the web
[1355] .php or .html extension? Morally Static Pages
[1351] Compressing web pages sent out from server. Is it worth it?
[1292] DHCP automatic IP address v Static IP
[1265] Apache, Tomcat, Jakarta, httpd, web server - what are they?
[1256] What country are you in? How we find out on our web site
[1198] From Web to Web 2
[1192] What are WEB-INF and META-INF directories?
[1176] A pu that got me into trouble
[1168] Moving out some of the web site bloat
[1121] Sharing the load with Apache httpd and perhaps Tomcat
[1080] httpd.conf or .htaccess?
[1031] robots.txt - a clue to hidden pages?
[1024] Web site - a refresh to improve navigation
[1020] Parallel processing in PHP
[1006] Apache httpd and Apache Tomcat together tips
[914] A practical example of roles
[853] To list a directory under httpd on a web server, or not?
[837] Tomcat - Shutdown port
[755] Using different URLs to navigate around a single script
[746] Domain Listing Center and Domain Registry of America
[732] Where is a web site visitor browsing from
[690] Adding Virtual Hosts
[660] Stopping and restarting Apache httpd cleanly
[659] Web Application Components
[653] Easy feed!
[642] How similar are two words
[631] Apache httpd to Tomcat - jk v proxy
[576] Why run two different web servers
[532] Copyright - how much can I legally copy?
[526] Apache httpd - serving web documents from different directories
[523] Apache httpd release 2.2
[498] Why is Tomcat called Tomcat?
[468] Stand alone PHP programs
[466] Separating 'per instance' data from binaries and web sites
[465] Changing Tomcat's web.xml and reloading a web application
[436] Linking Apache httpd to Apache Tomcat
[332] Looking up IP addresses
[282] Short weekend
[260] Embperl
[49] Business is the predominant user of Tomcat, Perl and Tcl
[46] Near and far security
Top or
Show all for Apache HTTP and Tomcat Servers
[3069] Strings, Garbage Collection and Variable Scope in C++
- (new - 2010-11-25)[3068] Throwing your own exception in C++, and catching it
- (new - 2010-11-24)[3067] Using C and C++ functions in the same program - how to do it
- (new - 2010-11-24)[3057] Lots of things to do with and within a C++ class
- (new - 2010-11-16)[3056] C++ - a complete example with polymorphism, and how to split it into project files
- (new - 2010-11-16)[3053] Make - automating the commands for building and installing
- (new - 2010-11-16)[3052] Getting your C++ program to run
- (new - 2010-11-15)
Top or
Show all for C and C++ Programming
[3088] Melksham - two many councils?
- (new - 2010-12-16)[3050] Views of Melksham - November 2010
- (new - 2010-11-13)[3032] Coincidence, or Conspiracy - a wrong email address
- (new - 2010-11-06)[2995] A river in Melksham is not just for boaters.
[2984] Customer Review - Hotel Room, Melksham
Top or
Show all for Melksham
[3109] A weighty decision
- (new - 2010-12-26)[3078] Royal Wedding. How William and Catherine have changed our schedule
- (new - 2010-12-02)[3074] Running a course ... what if the tutor isn't well?
- (new - 2010-11-29)[3065] Pictures from the Birkenhead to Belfast crossing
- (new - 2010-11-23)[3021] Courses for late 2010 and early 2011
- (new - 2010-10-30)
Top or
Show all for Training from Well House Consultants
[3103] Thank you - and Happy Christmas
- (new - 2010-12-24)[3073] Customer Service - the boundary
- (new - 2010-11-27)[3054] Longhope Hotel
- (new - 2010-11-16)[3024] Testing the new pavement ready for Christmas
- (new - 2010-10-31)[3014] Well House Manor - the next six years
Top or
Show all for Running a training and hotel company
[3115] Perl, Python, PHP, Lua, Linux, and more - and business hotel too. Menu for 2011
- (new - 2010-12-31)[3107] Hotel and Training Course prices - the effect of the VAT rise on 4th January 2011
- (new - 2010-12-26)[3071] Well House Price list, January to March 2011
- (new - 2010-11-25)[2962] Well House Manor - the history of the hotel
[2943] Our facilities to support Well House Consultants Courses
Top or
Show all for Well House Manor - Hotel and Training Centre
[3104] Catering in Syracuse, the Saigon Cafe, stolen images and Christmas
- (new - 2010-12-25)[3087] Making the most of critical emails - reading behind the scene
- (new - 2010-12-16)[3075] Change of balance, of attitude, and of work method
- (new - 2010-11-30)[3058] MacBook Air - hardware and system review
- (new - 2010-11-17)[3022] Retaining web site visitors - reducing the one page wonders
- (new - 2010-10-31)
Top or
Show all for For the Webmaster, Postmaster and moderator
[3112] Public and private courses - subjects available for 2011
- (new - 2010-12-29)[3102] AND and OR operators - what is the difference between logical and bitwise varieties?
- (new - 2010-12-24)[3100] Looking ahead and behind in Regular Expressions - double matching
- (new - 2010-12-23)[3093] How many toilet rolls - hotel inventory and useage
- (new - 2010-12-18)[3091] How do regular expressions work / Regular Expression diagrams
- (new - 2010-12-17)[3072] Finding elements common to many lists / arrays
- (new - 2010-11-26)[3063] Comments in and on Perl - a case for extreme OO programming
- (new - 2010-11-21)[3049] Computer Graphics is fun - even if Java Applets are Old Hat
- (new - 2010-11-13)[3042] Least Common Ancestor - what is it, and a Least Common Ancestor algorithm implemented in Perl
- (new - 2010-11-11)[3026] Coding efficiency - do not repeat yourself!
- (new - 2010-11-02)
Top or
Show all for General Programming Topics
[3094] Setting your user_agent in PHP - telling back servers who you are
- (new - 2010-12-18)[3036] Sending out an email containing HTML from within a PHP page
- (new - 2010-11-07)[3029] PHP data sources - other web servers, large data flows, and the client (browser)
- (new - 2010-11-04)[3027] Server logs - drawing a graph of gathered data
- (new - 2010-11-03)[3025] Learning to Program ... in PHP. Course examples.
- (new - 2010-11-01)
Top or
Show all for PHP - the language and its application
[3048] String handling - from first steps to practical examples
- (new - 2010-11-13)[3047] What is a universal superclass? Java / Perl / Python / Other OO languages
- (new - 2010-11-13)[3046] Java Beans, tag libraries and JSPs - what and why.
- (new - 2010-11-13)[3045] After Course Resources - do we publish sample answers. Example from Java Exceptions module.
- (new - 2010-11-13)[3044] Changing a Servlet - more that just editing and compiling
- (new - 2010-11-12)[3043] Gathering information - logging - with log4j. First steps.
- (new - 2010-11-12)[3041] Java - basic rules for arithmetic, variables and conversion
- (new - 2010-11-10)[3040] Doing several things at the same time - Java threads
- (new - 2010-11-10)[3039] Fresh Paint - Java Arrays
- (new - 2010-11-09)[3038] Setting up individual variables, and arrays, in Java - some commented examples
- (new - 2010-11-09)
Top or
Show all for Java and the Java Environment
[2923] Fresh air and beautiful places in Wiltshire
[2882] Seeing Wiltshire - from a Melksham base
[2830] Poulshot Village Fete
[2750] Views of Wessex
[2713] History is all around us
Top or
Show all for Around, about and nearby to Wiltshire
[3106] Buckets
- (new - 2010-12-26)[3105] Adventure with references to lists and lists of references
- (new - 2010-12-26)[3098] Learning Object Orientation in Perl through bananas and perhaps Moose
- (new - 2010-12-21)[3097] Making Perl class definitions more conventional and shorter
- (new - 2010-12-20)[3077] Perl 6 - significantly nearer, and Rakudo looks very good
- (new - 2010-12-02)[3059] Object Orientation in an hour and other Perl Lectures
- (new - 2010-11-18)
Top or
Show all for The Perl Programming Language and its use
[2913] Six languages in one file - an HTML++ web page
[2675] Redirecting to your main domain for correct security keys
[2628] An example of an injection attack using Javascript
[2554] Adding retrospective ALT attributes to IMG
[2390] Dynamic / changing images on your web page
Top or
Show all for Client Side Languages (HTML, CSS, Javascript)
[2980] Ruby - examples of regular expressions, inheritance and polymorphism
[2979] Ruby - yield; parallel routines
[2977] What is a factory method and why use one? - Example in Ruby
[2976] Creating, extending, traversing and combining Ruby arrays
[2975] Why do I need brackets in Ruby ... or Perl, Python, C or Java
Top or
Show all for Ruby and Ruby on Rails
[3099] Perl - database access - DBD, DBI and DBIx modules
- (new - 2010-12-22)[3061] Databases - why data is split into separate tables, and how to join them
- (new - 2010-11-20)[3060] INSERT, DELETE, REPLACE and UPDATE - changing the content of SQL tables
- (new - 2010-11-19)[3035] How to display information from a database within a web page
- (new - 2010-11-07)[2861] MySQL and Java - connectivity past, present, and future thoughts
Top or
Show all for SQL and MySQL
[3066] Separating groups of variables into namespaces
- (new - 2010-11-24)[3009] Expect in Perl - a short explanation and a practical example
[2681] Tcl - a great engineering language
[2476] Tcl - uplevel to run code at calling level
[2475] Quick easy and dangerous - automated logins via Tcl / Expect
Top or
Show all for Tcl, Tcl/Tk and Expect
[2951] Lots of way of converting 3 letter month abbreviations to numbers
[2949] Lua - variable function arguments and select
[2947] Teaching Lua to a Perl advocate
[2727] Making a Lua program run more than 10 times faster
[2723] Returning multiple values from a function - Lua
Top or
Show all for Programming in Lua
[3092] wxPython geometry - BoxSizer example
- (new - 2010-12-17)[3090] Matching to a string - what if it matches in many possible ways?
- (new - 2010-12-17)[3089] Python regular expressions - repeating, splitting, lookahead and lookbehind
- (new - 2010-12-17)[3086] Sizers (geometry control) in a wxPython GUI - a first example
- (new - 2010-12-15)[3085] Object Oriented Programming for Structured Programmers - conversion training
- (new - 2010-12-14)[3083] Python - fresh examples from recent courses
- (new - 2010-12-11)[3082] XML handling in Python - SAX, DOM and XSLT examples
- (new - 2010-12-09)[3081] wxPython - simple example to add GUI to a server log file analysis
- (new - 2010-12-08)[3076] Python through the Snow
- (new - 2010-12-01)
Top or
Show all for Python Programming
[3110] The days after Christmas
- (new - 2010-12-27)[3108] My First Christmas
- (new - 2010-12-26)[3101] The week before Christmas
- (new - 2010-12-23)[3096] Contrast in pictures
- (new - 2010-12-20)[3095] The Christmas Season has arrived
- (new - 2010-12-19)[3070] Belfast, on a cold November evening
- (new - 2010-11-25)[3064] On the way to the course this week
- (new - 2010-11-22)[3062] Melksham Carnival - getting ready for 2011
- (new - 2010-11-20)[3055] Zyliana Kyrei Cox
- (new - 2010-11-16)[3051] Positively reforming the system - could it be done?
- (new - 2010-11-14)[3037] Looking back and forward personally - 6 years each way
- (new - 2010-11-08)[3034] Birth Notice - Aeryn Cassandra Ellis
- (new - 2010-11-07)[3028] VAT rise in January - it is really up 14% not just 2.5%
- (new - 2010-11-03)
Top or
Show all for And also ...
[3114] Transwilts Link - both Wiltshire and beyond
- (new - 2010-12-30)[3113] Trowbridge and Melksham to Chippenham - more roadworks, even slower journey over the winter
- (new - 2010-12-30)[3111] TransWilts Link - Days out from Swindon to Weymouth?
- (new - 2010-12-28)[3080] Santa Special - rather more special than usual - December 2010
- (new - 2010-12-07)[3079] TransWilts Rail News ... Melksham (Santa Special) Edition ... 5th December 2010
- (new - 2010-12-04)[3033] Rail services back to Radstock?
- (new - 2010-11-07)[3031] Get all your ducks in a row ... and they may turn into swans
- (new - 2010-11-06)[3023] Autumn walk from Bowerhill
- (new - 2010-10-31)
Top or
Show all for Public Transport
[3084] Can you trust the big brand names?
- (new - 2010-12-12)[3030] Liquorice allsorts and Dolly Mixtures
- (new - 2010-11-05)[3013] Audio equipment
[2945] Last, final, etc
[2944] What others cannot do in 10 months takes Virgin 10 minutes
Top or
Show all for Fun and Flames
[2483] Clustering on Tomcat
[2384] Looking ahead to the Autumn season of training and accommodation
[2144] Looking for a career change - Physician to Web Site Designer
[1955] How to avoid duplicating web page maintainance
[1857] November and December Public Course Schedule
Top or
Show all for Keynote Articles
[2896] LAMP - Linux, Apache, MySQL, PHP - install, configure, administer
[2831] Recording (a macro) in vi
[2639] su or su - ... what is the difference?
[2638] Finding what has changed - Linux / Unix
[2636] Linux - useful tips including history and file name completion
Top or
Show all for Linux and Shell Programming
Public Transport • Training from Well House Consultants • And also ... • Tcl, Tcl/Tk and Expect • Programming in Lua • Python Programming • Well House Manor - Hotel and Training Centre • Apache HTTP and Tomcat Servers • The Perl Programming Language and its use • Ruby and Ruby on Rails • PHP - the language and its application • C and C++ Programming • Linux and Shell Programming • Melksham • SQL and MySQL • For the Webmaster, Postmaster and moderator • Java and the Java Environment • Fun and Flames • Running a training and hotel company • Around, about and nearby to Wiltshire • Client Side Languages (HTML, CSS, Javascript) • Keynote Articles • General Programming Topics
A little more about this newsletter ...
At Well House Consultants, we run niche IT training courses ... and we run a hotel for delegates on those courses and other visitors to Melksham too. And we make a lot of friends - have a lot of ambassadors with whom we want to keep in touch. So every day Graham (that's me, writing this piece) puts together an article or two which might include the latest sample programs that I've written during the current course, new information about
Well House Manor - our business hotel, tips on search engine optimisation,
announcements of upcoming public courses, pictures of local places, and even (on occasions) rants and whimsical pieces to keep those friends up to date and in touch. The feeds are available directlt via the Blog -
"The Horse's Mouth", they're on our
Twitter Feed and you can find me at my
LinkedIn profile.
But most people just want to look us up occasionally - every month or two, and then to catch up on the latest news just for their particular subjects of interest ... and that's what this newsletter is about
You'll find above the titles of ALL the new articles written in the last two months, listed by major subject area, and showing as
(new) with their date of publication. You'll find additional articles in each category too - topping each category up to a minimum of five articles. And you'll find a link at the end of each section which lets you expand that section to show the titles of every article that's been published in that section. After all, "the old ones are often the best ones", aren't they?