Home Accessibility Courses Twitter The Mouth Facebook Resources Site Map About Us Contact
 
Python and Tcl - public course schedule [here]
Private courses on your site - see [here]
Please ask about maintenance training for Perl, PHP, Lua, etc
 
Processing data line by line - iterator in Ruby with yield

If you have a big file / flow of data in Ruby, you probably don't want to read it all in to an array before you do any processing. Not only would that mean you couldn't produce any output until you have read all the data, but it would also make for a big process - probably inefficient, possibly doing a lot of swapping, and perhaps even running out of memory.

Ruby's yield keyword allow you to suspend the operation of a method and pass control to a block defined in the calling code, which may in itself call another method. Using this technique, you can in effect write parallel code, where one method is the equivalent of a Python generator, and another method or methods perform as steps in the processing of each record of data released (one by one) by that generator.

Sample code [here].

(written 2016-05-19)

 
Associated topics are indexed as below, or enter http://melksh.am/nnnn for individual articles
R112 - Ruby - Parallelism
  [3156] Splitting data reading code from data processing code - Ruby - (2011-02-04)
  [2979] Ruby - yield; parallel routines - (2010-10-01)


Back to
Reading in XML in Ruby with xmlsimple
Previous and next
or
Horse's mouth home
Forward to
Ruby testing with RSpec - a new example
Some other Articles
Melksham Station - as at May 2016 - Part 1
Saudi Arabia or Weymouth?
One line scripts - Awk, Perl and Ruby
Ruby testing with RSpec - a new example
Processing data line by line - iterator in Ruby with yield
Reading in XML in Ruby with xmlsimple
Expect with Ruby - a training example to get you started
Swindon, Chippenham and Melksham - day trips by train to Weymouth start for 2016
Running shell (operating system) commands from within Ruby
Exceptions in Ruby - throwing, catching and using
4759 posts, page by page
Link to page ... 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96 at 50 posts per page


This is a page archived from The Horse's Mouth at http://www.wellho.net/horse/ - the diary and writings of Graham Ellis. Every attempt was made to provide current information at the time the page was written, but things do move forward in our business - new software releases, price changes, new techniques. Please check back via our main site for current courses, prices, versions, etc - any mention of a price in "The Horse's Mouth" cannot be taken as an offer to supply at that price.

Link to Ezine home page (for reading).
Link to Blogging home page (to add comments).

You can Add a comment or ranking to this page

© WELL HOUSE CONSULTANTS LTD., 2019: 404 The Spa • Melksham, Wiltshire • United Kingdom • SN12 6QL
PH: 01225 708225 • EMAIL: info@wellho.net • WEB: http://www.wellho.net • SKYPE: wellho

PAGE: http://www.wellho.net/mouth/4680_Pro ... yield.html • PAGE BUILT: Sat May 27 16:49:10 2017 • BUILD SYSTEM: WomanWithCat