For 2023 (and 2024 ...) - we are now fully retired from IT training. We have made many, many friends over 25 years of teaching about Python, Tcl, Perl, PHP, Lua, Java, C and C++ - and MySQL, Linux and Solaris/SunOS too. Our training notes are now very much out of date, but due to upward compatability most of our examples remain operational and even relevant ad you are welcome to make us if them "as seen" and at your own risk.
Lisa and I (Graham) now live in what was our training centre in Melksham - happy to meet with former delegates here - but do check ahead before coming round. We are far from inactive - rather, enjoying the times that we are retired but still healthy enough in mind and body to be active!
I am also active in many other area and still look after a lot of web sites - you can find an index ((here)) |
Processing data line by line - iterator in Ruby with yield
If you have a big file / flow of data in Ruby, you probably don't want to read it all in to an array before you do any processing. Not only would that mean you couldn't produce any output until you have read all the data, but it would also make for a big process - probably inefficient, possibly doing a lot of swapping, and perhaps even running out of memory.
Ruby's yield keyword allow you to suspend the operation of a method and pass control to a block defined in the calling code, which may in itself call another method. Using this technique, you can in effect write parallel code, where one method is the equivalent of a Python generator, and another method or methods perform as steps in the processing of each record of data released (one by one) by that generator.
Sample code [here].
(written 2016-05-19)
Associated topics are indexed as below, or enter http://melksh.am/nnnn for individual articles R112 - Ruby - Parallelism [2979] Ruby - yield; parallel routines - (2010-10-01) [3156] Splitting data reading code from data processing code - Ruby - (2011-02-04)
Some other Articles
Melksham Station - as at May 2016 - Part 1Saudi Arabia or Weymouth?One line scripts - Awk, Perl and RubyRuby testing with RSpec - a new exampleProcessing data line by line - iterator in Ruby with yieldReading in XML in Ruby with xmlsimpleExpect with Ruby - a training example to get you startedSwindon, Chippenham and Melksham - day trips by train to Weymouth start for 2016Running shell (operating system) commands from within RubyExceptions in Ruby - throwing, catching and using
|
4759 posts, page by page
Link to page ... 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96 at 50 posts per page
This is a page archived from The Horse's Mouth at
http://www.wellho.net/horse/ -
the diary and writings of Graham Ellis.
Every attempt was made to provide current information at the time the
page was written, but things do move forward in our business - new software
releases, price changes, new techniques. Please check back via
our main site for current courses,
prices, versions, etc - any mention of a price in "The Horse's Mouth"
cannot be taken as an offer to supply at that price.
Link to Ezine home page (for reading).
Link to Blogging home page (to add comments).
|