------ art_35603_31823073.1159379186373 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline On 9/27/06, Jordan McKible <jmckible / gmail.com> wrote: > > I'm making the back end for a feed reader. I plan to have a daemon > which periodically checks feeds for updates. The daemon will have one > refill thread responsible for maintaining a list of feeds to be updated. > It will also have n worker threads who pop feeds from the list and > process them. When the list is empty, the refill thread will sleep for > some amount of time (no need to update the feeds constantly), refill the > list of feeds, and signal to the workers to start up again. > > Here's a crawler class as I have it so far. I've removed some of the > nonrelevant parts. Have you thought through why this script needs to be threaded in the first place? Is there an external latency you need to capture? ------ art_35603_31823073.1159379186373--