En curso

Data Scraping using Tampermonkey or Greasemonkey

I have a script that I have been developing for a couple weeks and need to make it better.

My goal is to access a ssl webpage through a username and password that has tables that I need to scrape every 5 minutes and insert into MySQL. I have the DOM script that parses the tables and insert them into the Db but I need to make it automated on the client side since the data I need to access is behind a login session that if inactive will timeout after 2 hours.

The script needs to have some kind of error/debugging as well and if it doesn't run successfully after a couple tries send and email/text alert.

Another thing I've noticed is the page that I need to parse is access through a javascript post link. So the script might need to get the URL of the parse page for another page first and then parse use the URL it gets to parse the data. I'm sure it's possible. I think they did this to make parsing the page harder.

See attached scripts to see what I have so far and what I've tried. Also, there is token variable in one of the scripts. Please include the value of the token in your bid so that I know you've read my project. Thanks!

Habilidades: Extracción de datos, Javascript, jQuery / Prototype, PHP

Ver más: client side scripts, what is data scraping, greasemonkey, automated scripts mysql, text alert, php email parsing mysql, php parsing text, tampermonkey, scrape login data, php script parse email, greasemonkey mysql, php data parse, php parse error parse error, scrape data mysql, script tampermonkey, page scraping mysql, data scraping using, javascript send data, scraping data websites using, insert scrape data mysql, parse client side, scrape webpage, javascript timeout, php email parse script, data scraping php script

Información del empleador:
( 12 comentarios ) Rocklin, United States

ID de proyecto: #7192246

Adjudicado a:

rajeshsonisl

Hello! With 99% completion rate, 750 successfully completed projects, and a 5.00 reputation (maximum possible, 5.0) (Yes, not even 4.99 average rating, can be verified on my profile page [url removed, login to view] Más

$368 USD en 2 días
(566 comentarios)
7.6

7 los freelancers están ofertando un promedio de $272 para este trabajo.

fhasanbd

A proposal has not yet been provided

$377 USD en 7 días
(47 comentarios)
5.9
prashushinde9

Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bu Más

$309 USD en 10 días
(22 comentarios)
5.7
jenishfaldu

Hello ::) PHP expert is [url removed, login to view]'s discuss further and move ahead,waiting for your reply. Thanks a lot Jenish,

$222 USD en 6 días
(29 comentarios)
5.3
flashsaiful

Hi, I can do this for you. Please send a massage in the PMB for details.......Best Regards flashsaiful

$222 USD en 3 días
(24 comentarios)
4.5
pratyatech

I got a fair comprehension about your project. I have few questions, so please come on chat for further discussion. Benefits you get: 1. Free Technical Support and Warranty 2. Multiple Revisions Until Project De Más

$155 USD en 3 días
(8 comentarios)
4.0
sisodiakaran

Dear Employer, Let me introduce myself as an expert software programmer and am really interested in working with you. I have done many offline jobs. I am willing to complete your job at a very fast pace and at a min Más

$250 USD en 3 días
(4 comentarios)
3.8