Rails 2.2 + Apache 2.2 + RewriteBase /app = broken

I'm trying to run a rails app under an alias like this:

Alias /app /var/www/railsapp/public
RewriteBase /app
...

I am using the same configuration that has worked for the app under
Rails 1, but since I upgraded it to the latest version I get: