Collect the following information for ALL businesses in ALL U.S. cities on [login to view URL]
Company Name
Street Address
City
State
Zip
Phone
Business Categories
Website *If exists
Email Address *If exists
###### BIDS THAT DO NOT ATTEMPT TO ANSWER THE FOLLOWING QUESTIONS WILL NOT BE CONSIDERED ######
###### BIDS THAT DO NOT ATTEMPT TO ANSWER THE FOLLOWING QUESTIONS WILL NOT BE CONSIDERED ######
Please examine the website, and provide me with answers to the following questions:
1. Are there any rate limiting or other protection features that will inhibit your ability to scrape this website? If so, how will you overcome them?
2. How will you ensure you get ALL of the companies from ALL of the cities? What pages of the site will you access/what logic will you use to traverse through the website?
Hi, I'd scrape the A-Z of categories and feed along with cities into the format http://www.superpages.com/yellowpages/C-Accident+Reconstruction+Services/S-AL/T-Auburn/ . I'd get around rate limiting using rotating proxies and a random search pattern. Thanks! :)
I am Data Entry Expert, MS Word and MS Excel. i am very much professional in this work i am pretty sure that you cant find a best person for this job like me so i am ready to work on your project with low rate and high quality.
I offer to provide the software that meets your needs. It will be a solution in Java, built on top of my own already developed, demonstrable web-scraper tool. The web-scraper tool is designed for complex web-scraping, is technically sophisticated and can scrape deep and wide - will prove very cost-effective when large number of sites are involved.
Please read my private message for more details.