Kev Jackson wrote:
> Hi
>
> I'm considering a side-project where I'd have to scrape a couple of
> websites and aggregate the results.  So far I've done a couple of
> experiments with html-parser, but I'm not really happy with it.  I'd
> hate to just throw regexps at the html, so I'm really looking for an
> elegant way to select the correct data from the page.
>
> Any ideas on what gems to use?
>
> Thanks
> Kev

Look at SWExplorerAutomation (www.webunittesting.com)
The program creates an automation API for any Web application which
uses HTML and DHTML and works with Microsoft Internet Explorer. The Web
application becomes programmatically accessible from any .NET language.

SWEA API provides access to Web application controls and content. The
API is generated using SWEA Visual Designer. SWEA Visual Designer helps
create programmable objects from Web page content.