First of all check of you can scrape your data in the background and process it locally. Then add Mongrel instances and just load-balance between them.
First of all check of you can scrape your data in the background and process it locally. Then add Mongrel instances and just load-balance between them.