> >Look at SWExplorerAutomation (www.webunittesting.com) >The program creates an automation API for any Web application which >uses HTML and DHTML and works with Microsoft Internet Explorer. The Web >application becomes programmatically accessible from any .NET language. > >SWEA API provides access to Web application controls and content. The >API is generated using SWEA Visual Designer. SWEA Visual Designer helps >create programmable objects from Web page content. > > > Perhaps you've misunderstood my intentions. I want to scrape a website (BBC News for example) and extract some data from the HTML returned. I want to use Ruby to do this and I also want to avoid using regular expressions to manually parse the HTML myself. Forgive me if I'm wrong, but your response seems to be an advert for an automation product for .Net. Someone else has already suggested RubyfulSoup which I've had some success with and I'm moving ahead with this for now. Kev