Serving rails application from server root

It depends on what level of control you have over your setup. The simple answer is to change the document root of apache (or whatever server you're using) to point to the root of your rails app.

Alternatively as long as you have mod_rewrite configuration allowed you could use it to rewrite everything to /site in the root public_html directory.