The tool you want is you. You write tests for you app then when you move forward into a new Rails version you run your tests and fix the issues, pretty simple actually.
Keep up to date with Rails on Twitter and This Week in Rails
Policies: Conduct, License, Maintenance, Security, Trademarks