x-sendfile horrendously slow?

You'll want to use another web server like nginx/apache/lighttpd.
They all have slightly different methods of doing this. nginx has the
X-Accel-Redirect, apache has mod_sendfile, lighttpd has
mod_secdownload...? I'm more familiar with nginx, but this should
provide some valid keywords to google. Good luck!