# About using WWW::Mechanize plugin

**URL:** <https://discuss.rubyonrails.org/t/about-using-www-mechanize-plugin/36387>\
**Category:** rubyonrails-talk\
**Created:** [November 15, 2008, 7:41pm UTC](https://discuss.rubyonrails.org/t/about-using-www-mechanize-plugin/36387 "2008-11-15T19:41:47Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![parkurm](https://avatars.discourse-cdn.com/v4/letter/p/90db22/32.png) [@parkurm](https://discuss.rubyonrails.org/u/parkurm)\
**Post date:** [November 15, 2008, 7:41pm UTC](https://discuss.rubyonrails.org/t/about-using-www-mechanize-plugin/36387/1 "2008-11-15T19:41:47Z")

</div>

Hi all,

&nbsp;&nbsp;&nbsp;&nbsp;Does anyone have the experience of using Mechanize to scrape webpages? I encountered a problem using Mechanize to parse enormous number of pages. As each time I use agent.get function to fetch a page, it keeps the log, and thus as time grows, the object size of the agent grows bigger and bigger, and consuming all my memory (4G). Is there any solution to this problem?