Online Courses Metasearch (php/html5/javascript)

The objective is to develop a comprehensive online course metasearch engine that simultaneously queries Skillshare, Udemy, and Domestika, displaying a consolidated and organized list of courses available. Since these platforms lack public APIs, the search will be performed live, scraping the websites to obtain and display results in real-time. The website should be built using PHP, incorporating modern technologies and best practices to ensure optimal performance, security, and scalability. Key Features: Homepage with Search Box: A clean and user-friendly homepage. A prominent search box to input queries. Options to filter and sort the search based on parameters like price, duration, rating, etc. Real-Time Search Results: Conducts live searches on Skillshare, Udemy, and Domestika using web scraping techniques. Efficiently fetches and displays results in a well-organized manner. Includes course titles, instructors, prices, durations, ratings, and brief descriptions. The results should also contemplate the pagination depending on the amount of results in each platform. Course Detail Page: Clicking on a course leads to a detailed page. Provides extensive information about the course, including a detailed description, curriculum, reviews, etc. A link directing users to the actual course page on Skillshare, Udemy, or Domestika. Responsive Design: Mobile-friendly design ensuring accessibility from various devices. Fast loading times and optimized performance for an enhanced user experience. Security and Compliance: Implement robust security protocols to protect sensitive data. Ensure compliance with legal requirements related to data protection and privacy. Technical Requirements: Frontend: HTML5, CSS3, and JavaScript for a responsive and interactive UI. Use Bootstrap or another popular CSS framework for efficient styling and layout. Backend: PHP for server-side processing. Utilize efficient web scraping libraries like Goutte or Simple HTML DOM Parser. Database: MySQL for storing cached data, user information, and other essential data to enhance performance and user experience. Caching and Performance Optimization: Implement caching mechanisms to store frequent search results temporarily, reducing the load time for popular queries. SEO Optimization: Ensure that the website is SEO-friendly to attract organic traffic. Analytics: Integrate tools like Google Analytics for tracking and analyzing website traffic and user behavior. Additional Information: Given that the search is real-time and involves web scraping, it’s crucial to ensure that the application is efficient and doesn’t overload the servers of Skillshare, Udemy, and Domestika. Also, make the code in a way that new services could be added in the future Deliverables: Complete source code. Documentation on the architecture, design, and deployment of the application. A fully functional website deployed on a live server. Please provide a detailed quote for the project, including the timeline for each phase, and any additional costs for maintenance and support post-deployment. Also, share your previous works similar to this project if available. Looking forward to your proposal. Thank you.