Home Accessibility Courses Twitter The Mouth Facebook Resources Site Map About Us Contact
Python, Lua and Tcl - public course schedule [here]
Private courses on your site - see [here]
Please ask about maintenance training for Perl, PHP, Java, C, C++, Ruby, MySQL and Linux / Tomcat systems

Phone System reconfiguration 11.1.2018 and 12.1.2018 - we are on email but incoming phone not available all the time
Analysing a web access log file
Python on the Web example from a Well House Consultants training course
More on Python on the Web [link]

This example is described in the following article(s):
   • Which (virtual) host was visited? Tuning Apache log files, and Python analysis - [link]

Source code: visitor.py Module: Y202
"""Web site log visitor class"""

from sys import stdout

class visitor:

""" Visitor to a web site - groups access log
   records by the address from which they have arrived"""

   def __init__(current):
      current.count = 0
   def addhit(current,line):
"""save a count, and full details of
      first and last visit from a host"""

      current.latest = line
      if not current.count:
         current.arrival = line
      current.count += 1
   def getcount(current):
      return current.count
   def __str__(current):
      result = "\nAccessed "+str(current.count)+" times\n"
      result += "First access\n"+current.arrival
      result += "Last access\n"+current.latest
      return result

def hostcompare(this,that):

"""Sort by host name - i.e.
        by country / top level domain
        by sub-top domain within country where applicable
        and finally by domain name within that group"""

   els1 = this.split("."); els2 = that.split(".")
   els1.reverse(); els2.reverse()
   linked1 = ".".join(els1); linked2 = ".".join(els2)
   return cmp(linked1,linked2)

# for future development - regular expression to
# identify where we only have an IP address available

# import re
# hostcompare.numeric = re.compile(r'^\d+\.\d+\.\d+\.\d+$')

def add_visitor(pool,line):
"""Utility to add record to a visit group"""
   elements = line.split(" ")
   remote = elements[0]
   if not pool.has_key(remote):
      pool[remote] = visitor()

if __name__ == "__main__":
   community = {}
   progress = 0
   for hit in open("/home/wellho/logs/access_log").xreadlines():
      progress += 1
      # progress bar - report every 5000 records
      if not progress % 5000:
            print "\r",progress," ",
   remotes = community.keys()
   for remote in remotes:
      print "%4d %40s" % (community[remote].getcount(),remote)

   print "details of 2000th visitor"
      print community[remotes[2000]]
      print "Less that 2000 visitors"
Learn about this subject
This module and example are covered on the following public courses:
 * Learning to program in Python
 * Python Programming
Also available on on site courses for larger groups

Books covering this topic
Yes. We have over 700 books in our library. Books covering Python are listed here and when you've selected a relevant book we'll link you on to Amazon to order.

Other Examples
This example comes from our "Python on the Web" training module. You'll find a description of the topic and some other closely related examples on the "Python on the Web" module index page.

Full description of the source code
You can learn more about this example on the training courses listed on this page, on which you'll be given a full set of training notes.

Many other training modules are available for download (for limited use) from our download centre under an Open Training Notes License.

Other resources
• Our Solutions centre provides a number of longer technical articles.
• Our Opentalk forum archive provides a question and answer centre.
The Horse's mouth provides a daily tip or thought.
• Further resources are available via the resources centre.
• All of these resources can be searched through through our search engine
• And there's a global index here.

Purpose of this website
This is a sample program, class demonstration or answer from a training course. It's main purpose is to provide an after-course service to customers who have attended our public private or on site courses, but the examples are made generally available under conditions described below.

Web site author
This web site is written and maintained by Well House Consultants.

Conditions of use
Past attendees on our training courses are welcome to use individual examples in the course of their programming, but must check the examples they use to ensure that they are suitable for their job. Remember that some of our examples show you how not to do things - check in your notes. Well House Consultants take no responsibility for the suitability of these example programs to customer's needs.

This program is copyright Well House Consultants Ltd. You are forbidden from using it for running your own training courses without our prior written permission. See our page on courseware provision for more details.

Any of our images within this code may NOT be reused on a public URL without our prior permission. For Bona Fide personal use, we will often grant you permission provided that you provide a link back. Commercial use on a website will incur a license fee for each image used - details on request.

You can Add a comment or ranking to this page

© WELL HOUSE CONSULTANTS LTD., 2018: Well House Manor • 48 Spa Road • Melksham, Wiltshire • United Kingdom • SN12 7NY
PH: 01144 1225 708225 • FAX: 01144 1225 793803 • EMAIL: info@wellho.net • WEB: http://www.wellho.net • SKYPE: wellho

PAGE: http://www.wellho.net/resources/ex.php4 • PAGE BUILT: Sun Jan 31 13:04:01 2016 • BUILD SYSTEM: WomanWithCat