Problem with openUri HTTPError

Hi, I'm having a issue when attempt to read this page:

and get the following error:

C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:277:in `open_http': 500 Internal Server Error (OpenURI::HTTPError)         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:616:in `buffer_open'         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:164:in `open_loop'         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:162:in `catch'         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:162:in `open_loop'         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:132:in `open_uri'         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:518:in `open'         from C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:30:in `open'         from prueba_fecha.rb:11

This is the code I'm using

url = "Office of Foreign Assets Control - Sanctions Programs and Information | U.S. Department of the Treasury;     doc = Hpricot(open(url))

Somebody can help me with it?

Hi, I'm having a issue when attempt to read this page:

Specially Designated Nationals And Blocked Persons List (SDN) Human Readable Lists | Office of Foreign Assets Control

C:/Ruby187/Ruby1.8.7/lib/ruby/1.8/open-uri.rb:277:in `open_http': 500 Internal Server Error (OpenURI::HTTPError)

Love it. Apparently that server is rather picky about the requests it's willing to service :slight_smile: Thank you, Treasury Department!

Anyway, try:

doc = Hpricot(open(url, "User-Agent" => "MSIE"))

=> #<Hpricot::Doc "\r\n" {doctype "<!DOCTYPE html PUBLIC \"-//W3C//DTD XHTML 1.0 Strict//EN\" \...

Note: this also works :slight_smile:

doc = Hpricot(open(url, "User-Agent" => "Zombies from Space"))

(A look through the open-uri docs will be useful for future reference.)

FWIW,

Ohh nice thanks for the help :slight_smile: