Find Jobs
Hire Freelancers

Sort List of URLS - Script Required

$30-250 USD

Cerrado
Publicado hace casi 7 años

$30-250 USD

Pagado a la entrega
I have a list of URLs. I want the script to do the following: Search for 1-3 pre-defined words on the homepage (Just the homepage) of these URLS. If these words exist, the URL is kept, if it doesn't, the URL is deleted. It should function online. Like the following: http://websiteseochecker dot com/extract-url-to-domain/ The script should be able to perform searches through URLs between 5000 to 10000 at one time fairly easy and fast. Is this possible? This needs to be a quality script.
ID del proyecto: 14029438

Información sobre el proyecto

23 propuestas
Proyecto remoto
Activo hace 7 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
23 freelancers están ofertando un promedio de $144 USD por este trabajo
Avatar del usuario
hello, i am expert with php and i can help you complete this project good and fast, please contact with me to start. kind regards.
$155 USD en 3 días
4,9 (391 comentarios)
7,4
7,4
Avatar del usuario
I am an expert in delivering custom software
$111 USD en 2 días
4,8 (151 comentarios)
7,5
7,5
Avatar del usuario
Hi there, sounds interesting! If I got it right, you want to check if the URLs in the input list conatin a few keywords or expressions and only return a list of URLs that do contain the target word or expression. It is possible and I have a solution in mind: a web crawler / scraper built on curl-php and using the simple_html_dom library to parse the html. Those are my common tools for building web scrapers and they should work. There are though a few issues: If you want this to work online, if the list of URLs is long the user will have to wait a long time, plus, you need a host that allows you to cancel the php timeout limit (set it to 0), else the script will timeout after 300 seconds or whatever value the host has. Some sites are using anti-robot mechanisms to deny access to bots. Some can be tricked, some can't be tricked or not without cost. Some sites output html text after executing a javascript - a php bot can't do that so no content from there. There are solutions like using a headless browser like phantomjs to execute javascripts but costs don't justify the result. Bottom line is that it can be built, it can run fast but that depends on the length of the list. Under no circumstances you can parse 10000 URLs in a reasonable time. Each URL has to load and that ads up the time of execution. Message me if interested, I'd like to take it and develop it. Regards, Calin.
$200 USD en 3 días
5,0 (60 comentarios)
6,3
6,3
Avatar del usuario
hello there! if you want it that easy and FAST - why don't try a desktop application for that? you could run it in multithreaded mode (1000 urls checked simultanouslhy instead one by one), you can add your proxy list if needed. and time of development would be also pretty fast as i have all needed source codes developed while years of my web automation experience. if you think such solution would work for you - i'll be happy to talk about details. asking just $150 for this (+ freelancer's comission :))
$166 USD en 1 día
5,0 (8 comentarios)
5,9
5,9
Avatar del usuario
Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of experience of 5 years. b) I work very hard (16+ hours a day and 7 days a week) and also very fast so... it will be done very soon than most of the other providers c) And most important part is my policy: "I will give you (to my client) life time support (as long as you keep relation with me). And fix any bugs/problem without any cost. So, don't ever worry about me” Please sir, leave a reply ASAP, as I am waiting for your kind reply
$250 USD en 3 días
5,0 (31 comentarios)
5,6
5,6
Avatar del usuario
A proposal has not yet been provided
$125 USD en 1 día
4,8 (24 comentarios)
4,6
4,6
Avatar del usuario
Hello Sir i'm ready to start working on your project immediately. Feel free to ask me any questions that you have. Regards, Rumen!
$35 USD en 1 día
4,9 (26 comentarios)
4,3
4,3
Avatar del usuario
Hi. I am an expert in VBA, VBScript, Visual Basic, C#, F#, C, C++, ASM, Delphi, Java, iMacros, Flash, ASP, ASP.NET, Access, MySQL, MSSQL, QuickBooks, Oracle. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now
$150 USD en 3 días
4,9 (12 comentarios)
3,9
3,9
Avatar del usuario
Hello JB88! I understood your requirement. Among all freelancer we are one of best right person for this project. **Check our reviews to confirm our work quality.***We are expert in Applications development in PHP, C #, VB.net,ASP.Net, Oracle, SQL Server, MS Access,Web scraping, Macros etc..***We have 15 people to assist you.***we are committed to our work.*** We work 8 to 10 hrs per day and 24 X 7 available for communication support***We will deliver your project within the shortest possible time within your budget*** With Regards, Bhaskar, SBITServices
$100 USD en 3 días
4,4 (19 comentarios)
4,4
4,4
Avatar del usuario
Greetings, I am experienced and qualified developed have been working work in IT more than 10 years. I read your project description with a large interest and can propose you to create console application that will do the job. It will be multiprocessor and multi-thread application and it will check url's really fast. Also I can build it for all platforms (windows, linux, etc) if needed. Please invite me to discuss further details of the project and our cooperation. Thank in advance! Best Regards, Konstantin
$150 USD en 3 días
5,0 (9 comentarios)
3,8
3,8
Avatar del usuario
I'm an experienced PHP developer. I can create a PHP script for you which offers you two textboxes, one in which you enter all the URLs separated by newlines which you would like to search for keywords on, second textbox allows you to enter keywords separated by newlines. I will use cURL extension to fetch URLs. The script will take some time to go through 5000 to 10000 URLs. How fast will it work depends on your network connection. Another problem you'll encounter is the execution limit imposed by your server. Your server may terminate the script before it finishes execution. To mitigate this problem I suggest you to run this script from command line and provide input to it through a text file containing URLs.
$50 USD en 1 día
4,2 (13 comentarios)
3,6
3,6
Avatar del usuario
A proposal has not yet been provided
$97 USD en 3 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
over 16 years of programming,having programmed extensively in C++C#,MT4,cAlgo,cTrader,Java,OpenXavam C,VB, AI,ASP,NET,Python,PHP,Socket and Networking,Payment systems Excel programming etc and web development. Ability to consult and Program to clients need and ensuring deadline (Single clients/Industry). software architecture.
$135 USD en 3 días
0,0 (3 comentarios)
1,9
1,9
Avatar del usuario
I’m andy from China. To help customers achieve business dream is my happiest thing. After check your requirement about the project, I’m sure I can do it very well. I develop software from 2002 as a C++ developer, then I became a indie developer in 2012, focus on mobile development, iOS and Android. I have developed several iOS apps and several whole project for my customers all with myself. Except iOS, I also know well macOS and Android. Hope to create long-running cooperate relation with you.
$50 USD en 1 día
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Respected Sir we are Namita Technologies Services Private Limited(NTS) 6 year old Software organization from India. Myself Shreya Dhuriya, IT Manager of NTS; ensuring top notch web services and solutions are provided to clients across the world in the business sector. I personally have core abilities and experience in PHP, Ruby on Rails,Shopify, Android, payment Gateway, wordpress, CSS3 and MySQL programming etc. At NTS my team consists of colleagues with extensive experience and we all serve variety of companies ranging from start up to well establish business empires with our major focus being solely to provide web and mobile based solutions. our professional theme to provide the high quality services provided in various it sector include: web development, application development, database development which are mostly budget efficient and project are 100% finished before deadlines . i Am always available for communication with our respected clients. thanks
$180 USD en 4 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de CANADA
Vancouver, Canada
4,8
88
Forma de pago verificada
Miembro desde oct 13, 2003

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.