Rails 3.1 string conversion errors

I'm seeing many errors when installing Rails 3.1 and other gems.
These are all showing up in the ri/rdoc portion of the install
sequence and look like this: