Those are ANSI color codes.
In your environment.rb (with a recent Rails):
Rails::Initializer do |config|
(...)
config.active_record.colorize_logging = false
(...)
end
See http://glu.ttono.us/articles/2006/05/22/configuring-rails-environments-the-cheat-sheet for a good list of configuration options.