Scrape UN Treaty Collection

SUMMARY OF PROJECT Write a scraping program that produces an Excel database of information about United Nations treaties from the following online database: [login to view URL] The final deliverable will be a database of all information provided for each treaty. Each treaty has its own webpage, which you can access by following the link in the “Registration Number” column on the search page. Each treaty page should look similar to attached image #1 (link: [login to view URL]). You will use the search function to capture all the data for each treaty listed in a given month. The search page ([login to view URL]) looks like attached image #2. Use the “Dates” search function to capture the data provided for all 50,000+ treaties from 1946 to 2016 on a month-to-month basis, starting from the earliest treaties (December of 1946). It is important NOT to search using larger date ranges because the number of records displayed is limited to 500, so searches with larger ranges will cause us to lose records!! The database will include 2 outputs. The first is all the data from the “Main Table”. The second is the data from the “Action Table” just below the main table (see image #2). Not all treaties have an Action Table, but all of them have a Main Table. The suggested format for both portions of the database is included in the attached Excel sheet ("Sample output"), which also provides several example entries. However, there is some flexibility in how you approach the formatting as long as all data is captured accurately. Please review the example entries closely and READ ALL COMMENTS in the sheet for guidance on the formatting for each column. And feel free to ask questions at any point! OPTIONAL The ideal program will scrape the pages in a manner that mimics manual data entry, with 10 to 60 second intervals that vary in length between searches. DELIVERABLES 1. December 30 – Database with at least 1946 and 1947 completed 2. January 20 – Final database 3. Weekly check-ins with full database to date for review PAYMENT INFORMATION Installment 1 – After successful bid Installment 2 – After deliverable 1 Installment 3 – After final deliverable* *Contingent upon product meeting required specifications