Build an E-commerce site crawler

Cerrado Publicado Nov 21, 2012 Pagado a la entrega
Cerrado Pagado a la entrega

I need a custom crawler than can crawl 10,000s of pages from an e-commerce site (single domain) to collect the necessary product/pricing information that can be presented back in an XML file and Excel file format. I need to then integrate this file to my e-commerce site to add the necessary information to my product pages. I don't have my site ready yet but I will have to get the integration done based on the data I can get from the crawler. The crawler will also have to login to the website first before crawling the pages as the key information on the pages are only available when logged-in.

There are lots of open source software in the market than can be used to build this crawler so ideally I don't want to pay anything on an on-going basis. But I am happy to discuss the additional cost based on the platform that you suggest using, What I want is someone experienced to create the custom code for the crawler, ensure the data is collected and presented the way I need. I have to use the crawler on a weekly basis to crawl the pages and collect the data.

I can provide any more details that you need if you are interested in this project. Previous experience with creating web crawlers is a must. And I need this to be delivered within a week from the start date

Thanks,

Ozgur

Odd Jobs PHP Arquitectura de software

Nº del proyecto: #2792206

Sobre el proyecto

8 propuestas Proyecto remoto Activo Dec 28, 2012

8 freelancers están ofertando un promedio de $249 por este trabajo

enderium

Ready to start. Thank you!

$50 USD en 2 días
(85 comentarios)
5.4
NiceDeveloper

Hi, Please check inbox for details and samples of our works done. Thanks

$180 USD en 6 días
(23 comentarios)
5.1
renanreis

Hi, I ve already finished many scraper projects like this.

$60 USD en 5 días
(21 comentarios)
4.2
asoftech

==========I am ready to start. Kindly check my work details.=========

$200 USD en 10 días
(3 comentarios)
3.0
itconsultindia

ecommerce/php team

$400 USD en 4 días
(9 comentarios)
2.9
ebizworld1

Already we have experience for search engine web application. Crawler, Index and SE for web html content, image... So please consider my bid.

$300 USD en 5 días
(1 comentario)
0.0
kdeveloper5

HI, I can do this task for you, I have extensive experience in writing crawlers using Java and Python, I have written crawlers that can crawl websites and export data to csv. see you pmb for details

$500 USD en 7 días
(1 comentario)
0.0
reformconsulting

Dear Sir, Greetings! We are Reform Consulting with 5 year of experience under our belt. We are really interested to work on your project. Please see PM. Thank you. Regards, RCPL.

$250 USD en 15 días
(3 comentarios)
3.2