We have a Scrapy project already working on a Linux Server, extracting data from several e-commerce sites, and we need add 5 spiders more.
The site names will be showed after project acceptance.
Requirements:
1) The code should be integrated to a existent project.
2) The spider must store data in to a mongodb (already created).
The field to store are:
name
description
id (unique by site)
price
url
site_name
timestamp (date when the product is updated)
3) Before store an item to Db, you should verify if this same product already exist, if not, you should insert a new one, if yes you should update the existent. The way to know that is by, id and site_name.
4) One of the sites, requires signing before browse the catalog, the spider must manage this logging.
The project payment will be divided in 5 hitos. We consider as the final of each one, the end of crawling of one site.
Hi sir,
I am scraping expert, I have did too many similar projects, please check my feedback then you will know.
Can you tell me more details? then I will provide demo data for you.
Thanks,
Kimi
hello , sir :
i have strong skills on c/c++ & python , worked for samsung & huawei .
Now I am woking on SDN with c++ and crawler with python
i am familiar with scrapy & mongodb , maybe you could tell the link and things you want ,
the task can be finished soon
hope to get message from you, maybe more details is helpful
thank you very much .
Hello! I've had relevant experience, which is necessary to complete your project. In general it's clear what is necessary to do, but I'd like to get more details about existent infrastructure:
1. Are your spiders already stored something to mongodb, or it should be done from scratch?
2. Would it be possible to take a look on existent spiders, for easier integration with existent code base?
3. Would it be possible to work on my machine, or it will be necessary to work on your server via SSH?
Waiting for your reply. Best regards.
I have performed similar work recently, so I will be able to deliver quickly. I am currently 100% available. I am a linux, python, scrapy and mongodb expert.
Hi,
I have done 4 scrapping projects and got 5 starts. Please check my profile. I can deliver faster scrapper. Hope I would be your choice.
Thank you
Regards
Vikas
Hello, I have a lot of knowledge and experience for this job.
If You hire me this project will be done efficiently and fast.
Feel free to contact me if You have any questions.
Kind regards,
Nino Rasic