To follow up on my own question: I ended up writing a script to take care of it. It travels recursively through the entire directory of classes, calling "runtest.rb <filename>" for each file. I had to trap stderr to make the output readable, but it didn't take that long. F.