Website Crawler / Scraper

$15-25 USD / hour

En curso

Publicado

hace más de 5 años

$15-25 USD / hour

I need a website crawler to crawl the following websites for "For Sale By Owner" and "Make Me Move" in the location "Staten Island, NY" / Brooklyn, NY" and "Manhattan, NY” - Zillow - [login to view URL] - For sale by owner . com - Trulia The output must be in Excel. The excel must have the following columns: address Owner Phone On Do Not Call List? (Yes, No, No area code) URL And the URL must be the Zillow url or any other websites that has information. I need the crawler to run automatically every morning and to email the results to an email address. The crawler must cross reference the phone numbers from the crawler with phone numbers on an “XML” list that I will be able to post into the program on a daily basis to refresh the list. If there is no match with the do not call phone numbers, then mark "No" to do not call list - if the first 3 digits of the owner's phone number is not one of the 5 phone area codes that are provided, it must state "No list for area code". The crawler must be sorted by “On Do Not Call List” with “NO” on the top Additionally, the crawler must be able to send emails automatically to all of the listings on the websites that are “For Sale By Owner” And the crawler must be able to pass Captcha tests – I can manually watch it as it runs and pass the captcha tests for it

Java

PHP

Software Architecture

Web Scraping

XML

ID del proyecto: 18091013

Información sobre el proyecto

21 propuestas

Proyecto remoto

Activo hace 6 años

¿Buscas ganar dinero?

Dirección de email

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto

Cobra por tu trabajo

Describe tu propuesta

Es gratis registrarse y presentar ofertas en los trabajos

Adjudicado a:

@devi222

Hi Sir, I can create a Python script with all the features you asked, I have already created script for Trulia and Zillow. I’m a Python Programmer. I have created many Bots to scrape the websites like Amazon(UK, USA, AU, de),Alibaba(suppliers data), Linkedin, Facebook, Trulia(real estate, homes), [login to view URL], Amazon(using API), Aliexpress, yellowpages(au,nz,us,uk), superpages etc. My Sample project: https://www.freelancer.com/projects/project-14583096/ Here you find some of my previous jobs. * Created a python+selenium bot to scrape products from typical vendor sites with login such as [login to view URL], [login to view URL], [login to view URL], etc. * Created Product Ordering Bots & Invoice Generator which will take products ordered in Seller Amazon & Aliexpress Accounts and reorder them in another Amazon & Aliexpress Buyer Accounts with all options such as color, sizes, variations etc,. selected. * Created a Scraper using Python to scrape real estate data from [login to view URL] which will search from the address and postcode provided in the input file. * Scraped almost all types of Business data like Restaurants, hire/rental Companies, Fitness centers, Home Improvements etc . *2 Million wordpress sites scraped in Just 1 Day which will tell you my scraping speed.

$20 USD en 40 días

4,8

(152 comentarios)

7,0

21 freelancers están ofertando un promedio de $20 USD /hora por este trabajo

@zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan

$20 USD en 40 días

4,9

(176 comentarios)

7,9

@nataliaomelchenk

Hi there. Nice to meet you. I'm a Web scrapting expert and FULL Time Developer. I have checked your requirements carefully. I have rich experience in web scraping, Python, PHP, Micro, MySQL, etc . I can start work immediately now for you and can provide you perfect result for your requirements. Please let's discuss your project and reasonable price for this project in more detail. Thanks.

$22 USD en 40 días

4,9

(64 comentarios)

7,6

@schoudhary1553

Hello, Hope you are doing well. I can help with you in your project Website Crawler / Scraper. I can assure you the quality job. I have good experience in Java, PHP, Software Architecture, Web Scraping, XML. We have worked on several similar projects before! We have worked on 400+ Projects. Please check the profile reviews. I can deliver your job with in your deadline. Please ping me for more discussion. I can assure the 100% job satisfaction. Thanks,

$20 USD en 40 días

4,9

(140 comentarios)

7,4

@ferozstk

Hello, After reading your project details I believe I'm suitable for this project. As I'm expert on this kind of project with more than 5 years experience. Please feel free to contact me. I am looking forward to hear from you. Best regards

$25 USD en 4 días

4,9

(151 comentarios)

6,8

@sunmoon25

Hello I understood the task. I will show you sample before start the work. I ensure I will give you all accurate data as stated. I have done many difficult web scraping projects successfully. Please contact with me for discussion. Thank you.

$20 USD en 40 días

4,9

(76 comentarios)

6,4

@fleedsteed

Hi client I just check the functions and specs for this project I have done many projects with scrapy and other python libraries I can do this project with nodejs or python, c# I can also able to manage the crawl of the website The deadline is 2 days and ill deliver all related works to you Looking forward to hearing from you Regards Bingbing

$22 USD en 40 días

4,7

(32 comentarios)

6,2

@retroshell

hello, I've read your project details, Creating Scrappers is my Skill. I've checked the websites and saw it's easy to fetch data, Demo projects: Scrapper for Google shop https://www.freelancer.com/projects/php/Google-shopping-scraping/ Scrapper to fetch YouTube data https://www.freelancer.com/projects/software-architecture/Youtube-Channel-Video-Listing-Program/ Scrapper and Data Processing for Youtube https://www.freelancer.com/projects/website-design/Video-Playlist-Program-Service/ I understand the range and importance of your task and I can provide you perfect result . Please lets talk more about the project in chat. Thank you

$18 USD en 40 días

4,9

(22 comentarios)

5,0

@Xeeshanah

Hi there, Read the description you have provided and I can provide you a Web crawler in c# and java based upon your preference if any. I am a professional developer and I have been working on similar projects for the last 1 year so I can assure you Web crawling /parsing/automation is not a problem for me. We can discuss further details in personal messages. Looking forward to hear from you. Regards, Zeeshan Ahmed

$20 USD en 40 días

4,9

(27 comentarios)

4,5

@DataHome

Hello there An expert scrapper at your service May be I can able to help you out with scrapping all your required details from listed site with given criteria Let us discuss further Kind regards Amaan

$16 USD en 40 días

5,0

(12 comentarios)

3,8

@bernardopoliv

Hello" How are you? I would love to join this project with you. I am a economist/developer for VBA and Python scripts. Web scraping is one of my strongest points in programming and as I can see in your project, seems to be a great scraping project. I have got some already complete scraping projects if you want to see. Finally, it will be no problem to store data in excel sheets for you to receive. Give me a chance, if I cant bring you results by tomorrow, you get another person for the job. Thank you for your attention. Hopefully you will give me a chance to show my work.

$20 USD en 40 días

5,0

(5 comentarios)

2,9

@arashbahrami1

Hi I’ll do it for you with JMeter Tools which is the most powerful testing and crawling tools to extract information with any format you need.

$16 USD en 1 día

5,0

(3 comentarios)

2,4

@ddev2152

Hi , I am expert i Java and scrapping job. Connect to me , so we can have a discussion on your project. Thanks

$33 USD en 40 días

5,0

(1 comentario)

1,4

@dedycatedinc

I have successfully delivered many projects in many different company and clients. I have a strong Programming and Management skills and always updates myself with Research and Development of new technologies to strengthen my knowledge and skills.

$16 USD en 40 días

0,0

(1 comentario)

0,0

@mmedmaalej

Hello, I'm a fullstack Java developer. I have extensive knowledge in working with Application Servers and server-side apps as well as front-end apps. I've always strong skills in DS and algorithms and have interviewed in advanced levels with top companies. Looking forward to talking to you to discuss further details. Regards, Mohamed Maalej

$22 USD en 40 días