Python for DataMunging and System Admin

Exercises, examples and other material relating to training module Y201. This module is presented on Private Courses and Specially Run Courses only

Background

Python is heavily used to extract statistics and trends from large data flows, and / or to reformat those flows as output from one program as input for another (otherwise incompatible) program. And it's also heavily used for data and data file management.

Related technical and longer articles

Log file analysis - short Python example

Articles and tips on this subject		updated
4438	Loving programming in Python - and ready to teach YOU how I like programming in Java, but I love programming in Python. It's been a real pleasure to get back to Python this morning. I'm teaching a private course in Cambridge this week, and a public python course the following week. And a new example as work my hand back in ... Scenario - I require to read ...	2015-02-22
4211	Handling JSON in Python (and a csv, marshall and pickle comparison) JSON - JavaScript Object Notation - has become the data encoding standard of choice for many applications far removed from the "Javascript" of its name. It's a compact, readable format which allows collections within a language (that would be lists and dicts in Python, for example) to be encoded into ...	2013-11-19
4088	Some tips and techniques for huge data handling in Python Python's an excellent tool for handling huge data sets and long-running programs, although some of the elements of the language that you'll use for such work aren't exactly things we teach on our Introduction to Python courses. Yesterday, however, I was teaching an Intermediate Python course, and had ...	2013-05-18
3479	Practical Extraction and Reporting - using Python and Extreme Programming "We seem to be getting a lot of signups from Germany" - so said my fellow administrator on the First Great Western Coffee Shop forum. At first glance is something of a surprise, as this forum is "provided by a First Great Western Customer, for First Great Western customers" and First Great Western run ...	2011-10-14

Examples from our training material

lfan	Demonstration program - many aspects of Python
noisesource	Spike solution - Data extraction and reporting
rqsummy	Splitting a line at any white space
sbs	Data Munging Example
spamdata.txt	Data for spam signup demo

Background information

Some modules are available for download as a sample of our material or under an Open Training Notes License for free download from [here].

Topics covered in this module

The os module.
Stat and filecmp modules.
More on the sys module.

Complete learning

If you are looking for a complete course and not just a information on a single subject, visit our Listing and schedule page.

Well House Consultants specialise in training courses in Ruby, Lua, Python, Perl, PHP, and MySQL. We run Private Courses throughout the UK (and beyond for longer courses), and Public Courses at our training centre in Melksham, Wiltshire, England. It's surprisingly cost effective to come on our public courses - even if you live in a different country or continent to us.

We have a technical library of over 700 books on the subjects on which we teach. These books are available for reference at our training centre.