Console Scraper

[debil1974]

Hi guys
i am a total newbie so please be patient with me
I'm writing a project: a console application that will
1. loop and read info from a database table and use it as a filter to enter the zip code in a given website (using send-keys)
2. Read all the results on the website scrolling from the first to the last page
3. Read all the results on to a table
4. loop through the source database table and continue till last zip was entered

any idea ?

 

[Skydiver]

Yes. Talk to the website owners. Ask them if they have an API for you to use instead of scraping their page. If they don't have an API, make sure to ask their permission to scrape their data.