On Wed, May 14, 2008 at 2:50 PM, Robert Klemme
<shortcutter / googlemail.com> wrote:
> On 14.05.2008 13:29, James Dechiaro wrote:
>>
>> Thanks for the tip Robert I will give it a go...as the script has been
>> running for over 14 hours now after finding 13k matches =(
>
> Yet another approach would be to use a relational database for this.  If the
> volume is large it may pay off to import your CSV data into two tables,
> create appropriate indexes and get your result via a SELECT.

I agree that a large dataset like this probably doesn't belong in the
high-level programming domain.  Put the burden where it belongs.

For this type of data, the model would be simple in a database, as
would be the queries.

2c,
Todd