-
May 16th, 2010, 09:21 PM
#1
Google Scraper
First off.. Hi everyone, I just registered.
Next, Im coding a google scraper, and I am using the webclient to scrape pages, everything works pretty well, except sometimes google decides to give me a temporary ban while scraping pages, if I scrape too quickly.
So I want to pull the image (captcha) off of the page http://www.google.ca/sorry/ and then display it to the user so that they may continue to scrape pages.
Problem is, when I try to load the page so that I can get the url of the image... it throws an exception (Error 503 server unavailable). Can anyone here help me figure out how to fix this? Or maybe show me a better way to do what I am currently doing?
Thanks!
Chase
-
May 16th, 2010, 09:34 PM
#2
Re: Google Scraper
Sorry I cant find the edit button... But im using VB 2010 so I guess .NET 4.0
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
Click Here to Expand Forum to Full Width
|