Create Dynamic Reverse Proxy

Cerrado Publicado hace 5 años Pagado a la entrega
Cerrado Pagado a la entrega

Problem:

We are using different proxy services for scraping/crawling where we can only add 1 whitelisted access IP. But we are having different crawlers running with different IPs.

Solution:

All crawlers make their request via our "dynamic reverse proxy" to the service proxies. The service proxy get all requests from the same access ip (dynmaic reverse proxy).

Requirements:

- It should be fast (HAProxy, Ngnix, etc). It should handle thousands of requests concurrently.

- All headers should be passed through the dynamic request proxy.

- We should be able to easily add new upstream proxies. Optimum without downtime of the reverse proxy.

Please write a describe a brief architecture of you solution.

Looking forward to you propasal!

Linux Server Arquitectura de software Web Hosting

Nº del proyecto: #18305998

Sobre el proyecto

3 propuestas Proyecto remoto Activo hace 5 años

3 freelancers están ofertando un promedio de $257 por este trabajo

cjconstante

Hi there! I am a system administrator security focused with 6+ years of experience configuring services as proxies and vpn. I can help you to setup your reverse proxy as per your requirements using haproxy/nginx or an Más

$250 USD en 3 días
(47 comentarios)
6.1
readymakers

I am confident I am the right candidate for this project as I have done many similar projects in the past. With years of experience in this field, I believe this project will be very easy for me.

$367 USD en 7 días
(3 comentarios)
2.8