I ended up inserting my own middleware before Rack::Cache (which was actually causing the issue–I’d even tried removing Rack::ConditonalGet and the issue was still happening) that removes the If-None-Matches and If-Modified-Since headers on the matching requests.
Thanks for the help!