On Jan 31, 2006, at 1:11 AM, Kev wrote:

> Hi, I am looking for web crawler(spider) written in Ruby. I googled  
> but
> couldn't find much information. Can anyone give me some links?

The code I translated from Higher-Order Perl at the tail end of the  
following blog article may be of use to you.

http://blog.grayproductions.net/articles/2006/01/31/iterators- 
chapters-4-and-5

James Edward Gray II