Developer for Data Scraping Project

Completado Publicado hace 5 años Pagado a la entrega
Completado Pagado a la entrega

We need a dev who can create a program to scrape electrical permit data from a number of jurisdictions (state and city) in Washington and Oregon and dump the data into a CSV. We need to be able to run the script as needed, probably monthly or quarterly.

We will give you the websites where the data is stored, and you’ll take it from there.

Washington

L&I - [login to view URL]

MyBuildingPermit - [login to view URL]

Seattle - [login to view URL]

Spokane - [login to view URL]

Spokane runs on top of Accela. A number of places in Oregon also use the Accela platform which does have API access. Maybe this is the better place to get data rather than a web scrape

Oregon

A lot of Jurisdictions - [login to view URL] (click search, building permits) We only need Electrical permits and/or only one permit per address whichever has the most solar info.

Portland - [login to view URL]

We are interested in searching by:

A list of contractors (by name, contractor license #). We have this list.

If we add a new contractor to our “watch list” then we’ll need to go back and collect previous records for them across all jurisdictions.

Jurisdiction (all or selected)

Date range

Requirements

We need access to the code to maintain

Documentation in code (language not important)

We need some sort of UI for non-programmers to run the program

Must be able to run locally on a Windows computer

Must be able to search by (see above list)

Run reports as desired in aggregate or individually

Must be able to add a competitor to list and refresh the data pulled from various jurisdictions

Output should be a CSV file with the following data fields (where available):

Contractor ID/License

Contractor Name

Date Issued

Final Date

Expiration Date

Permit ID

Permit/Record Type

Project Title/Name (if available)

Project Description

Address

Jurisdiction

Status/Action

Permit url (if available)

Job Value (looks to be available for Oregon permits)

Extracción de datos Excel JavaScript PHP Python Arquitectura de software Extracción de datos web

Nº del proyecto: #17076248

Sobre el proyecto

22 propuestas Proyecto remoto Activo hace 5 años

Adjudicado a:

abedin94

hi, This is Pro Scraper Script writer Sid. I have scraped numerous site like adidas, yelp, aliexpress, ebay, SERP result and so on. Can do this very comfortably.

$252 USD en 2 días
(121 comentarios)
6.5

22 freelancers están ofertando un promedio de $785 por este trabajo

schoudhary1553

Hello, I can help with you in your project data scraping. I have more than 5 years of experience in Data Mining, Excel, PHP, Software Architecture, Web Scraping. We have worked on several similar projects before! W Más

$750 USD en 10 días
(409 comentarios)
8.1
seaanddream

Hi, my name is Selim. I will write a java code for you, with a simple UI, where you will be able to set your options before each run... I read your "Developer for Data Scraping Project" project descriptions carefully Más

$590 USD en 10 días
(386 comentarios)
8.2
hardcode4u

Hello, Hope you are doing well. I am an expert PHP developer having an experience of 9 years. I have done a scraper tool for Gumtree before and can do for you as well. We can have a chat for further discussio Más

$750 USD en 25 días
(165 comentarios)
8.1
Vlzinch

Hi! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can create crawlers to get the information from list of sites you've mentioned. Please con Más

$941 USD en 10 días
(96 comentarios)
8.0
augurstech

Dear Employer Hope you are doing well Coming to your project scope you can hire our exp developer for scraping electrical permit data from a number of jurisdictions (state and city) in Washington and Oregon and dump Más

$1411 USD en 20 días
(203 comentarios)
8.9
zekovicm

Hi there, As an Web Scraping expert i would like to scrape that data into csv for you. Please feel free to contact me to discuss further details. Best regards, Miljan

$705 USD en 7 días
(192 comentarios)
7.8
micheal4299

You can also check my portfolio: https://www.freelancer.com/u/micheal4299 I also have experience in working on similar projects. Let me know if you are interested in working with me. Thanks!

$750 USD en 12 días
(77 comentarios)
7.6
JinDongZhe

Hi,dear. i`m laravel and data scrabbing expert. I studied your requirements and i am very interested in discussion further regarding website. As i will provide you the website as per your requirements where you can Más

$555 USD en 10 días
(101 comentarios)
7.4
Venkat2011sri

Dear Hiring Manager, I am writing to apply for the position of Creating Tool. I possess seven years of experience as a virtual assistant and enjoy the variety of work the job brings each day. I can do this task with Más

$300 USD en 5 días
(186 comentarios)
7.1
axiomswb

I have expertise in web-scraping. Client's satisfaction is my first priority and believe in long-term relationship with clients. Thank you..

$250 USD en 10 días
(75 comentarios)
6.4
Harun1986

Hello, I have best web scraping skills and I can scrap all directory and any protected website. Please take a sample of your attached website. I will following all the details. Waiting for showing for the sample. Thank Más

$588 USD en 10 días
(211 comentarios)
6.7
shawnwilliams85

Hi I would love to discuss your needs further. I am a full stack developer with 10+years experience and extensive experience building optimized web applications for small to large scale businesses. I strive to off Más

$1764 USD en 10 días
(46 comentarios)
6.5
jkaranm

Hi, My name is Janis and I have been here in freelancer since 2014. One of the preferred freelancer because of the good standing and have good feedback from previous employers. I was asked by the freelancer staff Hele Más

$750 USD en 10 días
(41 comentarios)
6.4
AhmedSalahA

I will start with you no problem and talk to me because I need send to you some example and check my profile you will know I can do your project

$1176 USD en 20 días
(79 comentarios)
6.4
vw7209238vw

Hi, I have large experience scraping, please contact for details. Can review my profile and comments from my clients as a reference.

$705 USD en 15 días
(76 comentarios)
6.5