Find Jobs
Hire Freelancers

Protecting my website from crawler and scraper (30$).

$10-30 USD

Cerrado
Publicado hace casi 5 años

$10-30 USD

Pagado a la entrega
Protecting my website from crawler and scraper (30$). Hello! Thank you for having interest in this topic. As you know, Crawling and scraping have been always generalized. Even if you don't have very deep knowledge about it, you can make your own crawling tool just following a few steps in a tutorial that you could easily see in online. But still, there seem to be a way have a shield, control from it. [login to view URL] This is the website I happened to find accidently. When you navigate to the link and try right-clicking, or Ctrl+Shift+C, or Ctrl+S to download the webpage as html file. This is all blocked. Also it sends the pop-up message "You are not allowed to copy content or view source" I was surprised when I found this website. Because I thought it's technically, impossible. But in this website, not only blocking 'right-clicking', it also blocks to view the source of the webpage. So here I'm questioning specifics below. Question 1. How is protecting as such is possible? How did they install such blocking system to stay away from the crawl bot? Question 2. Do you know exact name of the service that the website is implementing to defend their own content? Question 3. Is it really possible to defend and block crawl/scraping access to your website and domain just like this website, Or it's just blocking it surface and it's actually possible to be by-passed? Question 4. Could you try install the same system as the website? I linked? Question 5. Other theoretical suggestions are welcome. (already built software tool or websites that showing the categorized form webs) Note : If you already have developed a similar task, this would be the best. Reward is only 30$. It's quite small in general view, But in this post I wanna get theoretical structure idea of these. Not demanding to build it right away. If we could get match well in this post by questioning and answering, I will proceed right next procedure to dedicate about building related tool/project/websites with you. :) Thank you for reading! Have a good day and bid me if you think you can complete one. Anytime ! And I am willing to respond very quickly to explain and describe more what I exactly need. also, if you can really make it out well this time in this project, I will promise to carry out further projects with you. Thanks alot.
ID del proyecto: 19303970

Información sobre el proyecto

7 propuestas
Proyecto remoto
Activo hace 5 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
7 freelancers están ofertando un promedio de $113 USD por este trabajo
Avatar del usuario
The approach to your problem is wrong. The truth is that everything can be bypassed in a way or another. The right approach is to make it worthless. All generic solutions that have been suggested can easily be bypassed by professional scrapers. For instance, ip blockers can easily be bypassed using vpn; same for Javascript solutions which disables right-click etc. The only solution is to make scraping worthless. What does it mean? If you use one of the 'generic' solutions (e.g. solutions used by a million other people), then there will probably be a million other people in the world that sooner or later will find the key which opens your door. Why? Because that key doesn't open only your door, but it opens also a million other doors. So it is worth for somebody to spend weeks or months to find that key. But if you use your own NON-GENERIC lock, then you get more security. Why? Well, also your own personalized lock is breakable, just like all the others. But is it worth? I mean, nobody will ever spend months of work just to find a key which opens only ONE door. Do not trust people saying it is an easy task, because it is not. They are just suggesting some of those generic solutions. Contact me if you want to know more.
$35 USD en 3 días
5,0 (8 comentarios)
3,9
3,9
Avatar del usuario
Hello, I looked though the website you mentioned. It uses some javascript code to disable the right click on the website. But the security there is very limited. For someone with a little bit understanding of the concepts it can be disabled. I tried to look through the source code of webpage and I am able to crawl it through my custom python script. Apart from disabling right click there is very less security and web crawling and data scraping can be done in the given website easily. If you want to disable data scraping in your own website there are various method in which it can be done. Lets discuss on chat. Thanks
$25 USD en 1 día
5,0 (3 comentarios)
2,4
2,4
Avatar del usuario
It is quite simple just capture the response of that website with help of some proxy tools like burp, and many more. you will get all the ideas. This things are implemented in front end codings. You can add it, lot of solutions are available in google. It is a free bidding. Thank You.
$10 USD en 1 día
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Protecting my website from crawler and scraper (30$). Hello! Question 1. How is protecting as such is possible? How did they install such blocking system to stay away from the crawl bot? - You can disable right clicks or control options using JavaScript Question 2. Do you know exact name of the service that the website is implementing to defend their own content? - .htaccess can be used to block ips and enhance security Question 3. Is it really possible to defend and block crawl/scraping access to your website and domain just like this website, Or it's just blocking it surface and it's actually possible to be by-passed? - disabling right clicks just stopping from surface Question 4. Could you try install the same system as the website? I linked? - Sure
$20 USD en 3 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de KOREA, REPUBLIC OF
Incheon, Korea, Republic of
5,0
15
Forma de pago verificada
Miembro desde feb 9, 2019

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.