How to parse rendered html page

I'm trying to write a website that parses all images in a given webpage. I initially tried to get all image links by looking for <img> tag, by using nokogiri html parser, and it works well with webpages without javascript.

Some pages use javascript to render the view, and using nokogiri, I'm just getting raw html results before it's rendered.

How can I get a page after being rendered by javascript?

parkurm wrote:

I'm trying to write a website that parses all images in a given webpage. I initially tried to get all image links by looking for <img> tag, by using nokogiri html parser, and it works well with webpages without javascript.

Some pages use javascript to render the view, and using nokogiri, I'm just getting raw html results before it's rendered.

How can I get a page after being rendered by javascript?

Webrat + Selenium would be one way.

Best,

You can try with Como evitar Fungos no Preparo do buffet de crepe that is like mechanize but supports javascript.