I downloaded the rubygems-1.3.5.tgz tarball from Ruby Forge and ran:

sudo ruby setup.rb

This installed Gems 1.3.5 over my previous version, so all of my old
gems remained in place.  (I wasn't sure that it would do this.)
Afterwards I was able to install newgem.  Problem solved.