Find and resolve HTTP request bottleneck

Cerrado Publicado hace 4 años Pagado a la entrega
Cerrado

We have a system which is checking proxy server uptime and experiencing an unexpected result after a recent server change. We need a server administrator that is comfortable with tuning PHP, Apache, PHP-FPM, MySQLi, and CentOS core. You as well need to be fluent with PHP multi-curl to understand how everything is working, in order to successfully resolve this issue for us.

Please note this issue is server config related, not software related.

The system uses PHP multi curl to select 20,000 nodes from the proxies and then process them in batches of 10,000. Requests are sent to our internal judge on the same server which returns information about the node that made the request.

The problem we are experiencing is that we are limited to the 10,000 batch. As we increase the batch amount, it's actually successfully checking less proxies. For example, with the 10,000 batch, the system might return 3,000 proxies that are currently up. If we increase that to a 20,000 batch, the system might find 500 proxies that are currently up, off the same exact data set which is surely not correct

On our previous server we could run batches of 100k without experiencing this type of issue but unfortunately, that administrator is no longer with us.

Any idea of what could be causing this issue for us? We are ready for immediate assistance!

PHP Linux HTTP cURL Administración de sistemas

Nº del proyecto: #21844742

Sobre el proyecto

37 propuestas Proyecto remoto Activo hace 4 años

37 freelancers están ofertando un promedio de $34 / hora por este trabajo

meet2amitvw

Dear employer hope you are doing well...Regarding project can we discuss more on this to get detail understanding about project ? As i am having some technical question on this so let me know when you get time to discu Más

$35 USD / hora
(173 comentarios)
9.3
devexpertsteam

Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Befo Más

$50 USD / hora
(103 comentarios)
8.7
tangramua

Hello, I got acquainted with your requirements, I am sure that I can help you with this. The fact is that I am a co-owner of a developer company and I myself am a PHP developer, and I also have administrators who can h Más

$35 USD / hora
(242 comentarios)
8.5
gursukh

yes sure I can help you right now

$27 USD / hora
(406 comentarios)
7.8
skynatstech

Hello there, Thameem here from skynats Technologies to help you. We have read and understood your project requirement and are happy to help you with HTTP request issue. We can start the work now and would require a d Más

$40 USD / hora
(418 comentarios)
7.0
srajbr

Hello, My approach would be to first check output of all the request. That way, we can find the error response. From then we can move ahead and take necessary steps. BTW what was your previous server specification and Más

$40 USD / hora
(34 comentarios)
6.5
MyAwesomeTeam

Dear Sir/Madam, I checked requirement and i think what you need is : + you need a server administrator that is comfortable with tuning php, apache, php-fpm, mysqli, and centos core + you as well need to be fl Más

$40 USD / hora
(55 comentarios)
6.2
milliard

and I am an expert in skills and My experience is 18 years. My hourly rate:$21/hr for this project. I can easily handle it. and My rate negotiable after discussion I will give you my final rate. message me....

$38 USD / hora
(35 comentarios)
6.0
techdevs

Hi! I`ve started from landing pages + seo 5 years ago. Than grew to a high-load big data solutions. I can do any complexity for angular, node or any other platforms (e.g. Laravel or yii 2). Please let me know when we c Más

$34 USD / hora
(12 comentarios)
5.2
jinridong19713

Hi thanks for your posting. I have read your post. I am a expert who have many experiences in web design&development. In particular, I had great experiences in laravel&codeigniter&Yii&Wordpress&node.js&react.js&angular Más

$25 USD / hora
(17 comentarios)
5.0
ancientb

Hello, Im experienced in Linux system administration including Server Security and optimization. Ill be able to identify the reason of the bottleneck (or maybe exhaustion of the socket/ports?!) in order to allow the sy Más

$26 USD / hora
(41 comentarios)
4.9
CX330

Greetings, The problem you are experiencing is possibly there due to two reasons: 1. Curl might be timing out on requests and not showing any errors 2. If you are on Linux, the kernel could be dropping connections B Más

$30 USD / hora
(11 comentarios)
3.8
Tomshon

Hello, ⭐⭐⭐How are you?⭐⭐⭐ I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I would love to work on your project and I'm confident that I can give the res Más

$38 USD / hora
(3 comentarios)
3.1
athminteam

Hi, This is Vipin, an alumnus of IIT Kanpur. I have 6+ years of experience in customized software, web and mobile app development and has expertise in Android, iOS, Python, Magento, PHP, HTML, Java, Angular and Ioni Más

$38 USD / hora
(3 comentarios)
1.5
achievers24

Hi, Thanks for sharing your requirements here. I’m an Experienced Freelancer with a demonstrated history of working in the internet industry. Skilled in Core PHP, MySQL, HTML, CSS, JQuery, JavaScript. I have worked m Más

$25 USD / hora
(2 comentarios)
1.5
CanvasInfotech10

Hello Sir, I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results with my team of developers, designers, QA and Project Manager an Más

$38 USD / hora
(1 comentario)
1.6
jack536

Hi, client. I'm professional full-stack web developer who have got 5 of experience on various kinds of projects. I am a expert in Custom PHP, MYSQL, WordPress, Drupal, Magento, Codeignitar, Angular JS, Web Services, No Más

$25 USD / hora
(0 comentarios)
0.0
FastAnswerSrv

Despite the fact that I have a low rating and I have no reviews at all. Nevertheless, I am a highly qualified professional and I am not a robot. :) Despite the fact that I use copy-paste, nevertheless I am not an artif Más

$25 USD / hora
(0 comentarios)
0.0