AWS Lambda Function Development for Parsing Emails to JSON

Project Overview: Our team is working on a multi-tenant event management system that leverages an event planning system with no APIs. We found a way to get the data we need from it in real-time. We will send email notifications detailing proposed catering events. Each email contains an HTML table encapsulating event data such as the client, salesperson, event quote, attendee count, venue location, date/time, and menu modules (menu item grouping for things like entree, drinks, appetizers etc.. and within the group the list of specific items) enclosed in {{}} brackets. We are seeking a skilled Python developer to create a serverless AWS Lambda function that will ingest these emails, extract the pertinent data, and transform it into a structured JSON format. This function will play a critical role in our data processing pipeline, ensuring efficient data extraction and seamless integration with our existing systems. The inbound emails should be received, stored as S3 objects for each respective tenant (each tenant having a unique email), and parsed using this Lambda function. We are interested in a clean and secure way of managing and parsing these tenant [login to view URL] will leverage Aws ses for email capture and storage to s3. Key Responsibilities: 1. Design an automated workflow to receive inbound emails and store them as individual S3 objects, categorized by unique tenant email. 2. Develop an AWS Lambda function using Python to parse these stored HTML emails into a structured JSON format. 3. Work with HTML parsing libraries such as lxml to handle variable rows in the email tables, specifically for menu modules. 4. Implement error handling and logging mechanisms for troubleshooting and reliability. 5. Ensure secure handling and confidentiality of the parsed data. 6. Thoroughly test the function for scalability and robustness against different conditions. 7. Document the code and provide operational support as needed. Technical Skills & Experience Required: 1. Proven experience in Python, with specific skills in data parsing and manipulation. 2. Familiarity with libraries such as lxml, Boto3, and JSON for HTML parsing, AWS operations, and JSON operations respectively. 3. Extensive experience working with AWS services, specifically AWS Lambda and S3. 4. Knowledge of Amazon SES or similar services for handling inbound emails would be advantageous. 5. Experience with secure coding practices and handling sensitive data. 6. Familiarity with multi-tenant architecture is a plus. 7. Proven ability to test code thoroughly for edge cases and potential errors. To achieve the goal of storing emails as S3 objects, we could leverage the Amazon Simple Email Service (SES). Amazon SES can be set up to automatically store incoming emails to an Amazon S3 bucket. You can also set up different receipt rules for different tenants (based on their unique email addresses) to store their emails in different S3 directories or buckets. The ideal candidate for this role is an experienced Python developer with a deep understanding of AWS services and secure data handling. Your track record should demonstrate your ability to work with AWS Lambda, AWS S3, and Amazon SES or similar services. If you have previous experience in building email parsing solutions and handling multi-tenant architectures, we'd be eager to speak with you. Please provide examples of similar projects you have completed, especially any involving AWS services and email parsing. We look forward to collaborating with you on this exciting project. Please also answer the question 3+ 3 = so we know it’s not a robotic bid. We see the project timeline as follows Setup basic ses routing rules = day 1 Parse table from email = day 1-2 Parse menu items and objects from table = day 2-4 Testing end to end = day 5 Troubleshoot = day 6-7