I have a text file with a couple hundred thousand rows that I use ruby
to massage and then active record to insert each row after being
massaged into the DB. Now... inserting a couple hundred thousand rows
using ActiveRecord and ruby is crazy. I know.
It was beautiful to write my rake task to do everything for me but now
the problem is time. For 1,000 records it is taking me on average
1:00 minute to process. I have an old PowerBook 867.
Now, I noticed when looking at the log file that the COMMIT opperation
is what is taking so much time. I was wondering if I can extend the
commit so the commit is done at the end or every X amount of updates?
Or any other suggestions on how to speed this up?
Thanks my friends :-).