urgent please :HTTPS html parsing

rubyonrails-talk
1

Hi, Is there any way to extract the html code of a https:// website in hpricot. When i use hpricot to access a https:// website i receive the following error.

/usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require': no such file to load -- net/https (LoadError)   from /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:31:in `require'   from /usr/lib/ruby/1.8/open-uri.rb:230:in `open_http'   from /usr/lib/ruby/1.8/open-uri.rb:616:in `buffer_open'   from /usr/lib/ruby/1.8/open-uri.rb:164:in `open_loop'   from /usr/lib/ruby/1.8/open-uri.rb:162:in `catch'   from /usr/lib/ruby/1.8/open-uri.rb:162:in `open_loop'   from /usr/lib/ruby/1.8/open-uri.rb:132:in `open_uri'   from /usr/lib/ruby/1.8/open-uri.rb:518:in `open'   from /usr/lib/ruby/1.8/open-uri.rb:30:in `open'   from demo.rb:15:in `valid'   from demo.rb:93

I'm also not able to load the html data gmail, youtube etc. Is it because i'm using hpricot. Is there any other way to extract https websites. Please help me.

Regards Arun Kumar

Attachments: http://www.ruby-forum.com/attachment/3452/demo.rb

2

Did you require 'net/https'? It seems that that lib is just not loaded/ present.

3

Harm wrote:

Did you require 'net/https'? It seems that that lib is just not loaded/ present.

On Mar 17, 1:05�pm, Arun Kumar <rails-mailing-l...@andreas-s.net>

Can u please explain about how to include 'net/https'.

Thanks a lot

4

> Please help. I'll be really thankful

> Regards > Arun Kumar

A quick Google search for 'rails https' yielded this on the 5th entry found. It seems like exactly what you need to do.

http://railsruby.blogspot.com/2006/02/https-open-uri-basic-authentica…

It also looks completely out of date - that patch doesn't look like it would apply to current versions of ruby 1.8.6 if net/https can't be required then I would assumed this is on a linux distribution where ruby is split into multiple packages, one of which is usually this one with ssl stuff in it ( libopenssl-ruby in ubuntu)

Fred