Amazon Read all Competitors from a SKU - fast and a lot to check -- 2

Hello sir. My freelancer ranking is top 5th and i am full stack developer. I am very interested in your project and I hope to work with you. I am ready to start work for your project. I have enough experiences with WEB development for 7+ years. I will complete your project perfectly in your deadline. Client satisfaction is my top priority. If you hire me, I will give you a very good satisfaction and I am ready to start the work. Please get in touch. I am looking forward to hear from you. Best Regards!

Hello!!! I have full experience in JSP, JQuery, PHP technologies. also , i have master laravel and codeigniter frameworks and anglar js, node js templates. keep in touch. my dear.

Dear Sir, I have 4 years of experience in wordpress/php/html/css. I have gone through your requirement and interested to work on your project. Please check my reviews and feedback for your reference. Thanks & Regards eGlobalSoft

Hello. As usual I'm using python/scrapy for such jobs, I can explain why. It uses async http request by using threading. In this case script don't wait for response but makes new http calls. No metter if you have to do 100 calls, but when you need to fetch 120k amazon bestsellers it really saves a time. I have done 3 data scrapping jobs for amazon. I'm allowed to show some parts of data. If needed I can download images too. Amazon can have different html structure for different products, or even not different products, so if want to be sure that script is accurate, hire me. Cuz there about 17 different selectors for price when you wanna to get all amazon bestsellers. Notice: I prefer python, it is faster than php. My bid includes installation of scripts and making some instructions. Also I can configure Django ORM and make a model for database storage. Please ask me about examples. Or link to upwork profile. Regards, Ivan

Dear Madam or Sir, I have great experience with Amazon PA API and have done a similar task in past in Python (with Pyspark) and Scala with Spark. Using Python or Scala has many benefits over PHP. Its faster, is easier to maintain, allows more fault tolerant programming (you dont want to start from the beginning when getting 20000 products ) and allows scaling, i.e. increasing the number of SKUs - especially with Spark - very easily. Please bear in mind that Amazon limits its API usage to 1 request per second. However, one can make 10 request simultaneously. Therefore, 20000 products take 2000 seconds, which are about 30 minutes. Am I correct that the SKUs are stored in a relational database like MySQL or MS SQL Server? Should the results (competitor name, ... ) be stored in the database as well? Getting the prices from the cheapest 10 (I am not sure about the exact number) competitors is easy and can be done in one request, since its just a parameter in the API. Getting the prices of all competitors requires paging and thus multiple requests. While this is possible, it increases the complexity, especially to make it fault tolerant. Do you need all competitors or just the cheapest 10 competitors? Please bear in mind that Python can be run as easy as PHP on many servers and will outperform PHP in efficiency and maintainability, since Python the the right language for data processing. Best regards