Develop a scraper to analyze information about a website

Completado Publicado hace 7 años Pagado a la entrega
Completado Pagado a la entrega

The code will run via API (No UI needed).

Input: a list of website URLS

Out put: The list of URL's with this extra data about the site:

- Company type: Manufacturer / Online Store / SMB (Suggestion to how to find this data is below).

- Is the website mobile friendly: yes / no

- Load speed (Homepage load speed in msec)

- Is Google analytics installed: yes / no

- Is there a link to facebook: yes/no

- What CMS is used: Wordpress / Joomla / Wix / Drupal/ ExpressionEngine / TextPattern / Radiant CMS / other.

- Contact form link (The URL where a contact form is, if there is one).

Finding the "company type":

In order to find this information, first analyze the text on the homepage.

1- Look for links with the text "products" "our products" "product catalog" also look for "distributors" "find a distributors" and so on. Usually companies that have a link with this language are "manufacturer".

2- Look for "cart" "checkout" or "add to cart" links. If these are present, this is an "online store"

3- Look for "opening hours" or "directions" in the website. Usually if this text is present, this is an "SMB" (small/medium business).

Procesamiento de datos PHP Python Arquitectura de software Extracción de datos web

Nº del proyecto: #11741982

Sobre el proyecto

15 propuestas Proyecto remoto Activo hace 7 años

Adjudicado a:

mwarrenschultz

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the website analysis program you require. To do so, I will use the l Más

$133 USD en 3 días
(69 comentarios)
6.5

15 freelancers están ofertando un promedio de $118 por este trabajo

mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Más

$68 USD en 2 días
(447 comentarios)
7.9
amitarai

Hello My name is Pranav I have checked the details shared by you will do done exactly what you want Please consider my bid and we can discuss more so that i can assist you in better way our services always with Más

$155 USD en 7 días
(84 comentarios)
6.2
sanidhayy

Hello, I am a Highly Experienced Freelancer from India. I have read your project description and I have some questions regarding your project. I would like to talk to you directly to discuss more about the project. You Más

$165 USD en 1 día
(13 comentarios)
4.1
arthurbarros

Pretty straight forward we could even use Google Pagespeed API to extract even more meaningful data. I intend to use Python 2.7, python-mechanize, requests lib, RabbitMQ as a Queue broker and MongoDB as the database wh Más

$140 USD en 2 días
(1 comentario)
0.2
shumiakter

Dear sir Your project is based on..............................I have done many job like as your project. Provide me your budget, time frame and more detail's please ! Thanks.

$35 USD en 3 días
(0 comentarios)
0.0
saymajahan

Hi, I'm Sayma Jahan. I have enough experience in this field. I can easily complete this project as per your instructions. How much is your budget and how long will be the time frame? Thank you.

$30 USD en 3 días
(0 comentarios)
0.0
muhamedze

A proposal has not yet been provided

$55 USD en 1 día
(0 comentarios)
0.0
halilceliksu

I and my friend are python proggramer. We wrote some codes that get and analyse urls and informations from different news web sites. So we can do what you want.

$88 USD en 3 días
(0 comentarios)
0.0
DavHack

A proposal has not yet been provided

$45 USD en 2 días
(0 comentarios)
0.0