Spark Developer

Job description Key Responsibilities • Understanding Business Requirements and Functional Requirements provided by Architect/internal stakeholders to develop & deploy the Spark and Java -based solutions • Design and development of applications /Application features well within timelines, conforming to the quality standards/best practices and expectations throughout the development life cycle in Java, Spark, and Big Data technologies • Owns the assigned components/product features, develops the solution or feature implementation and responsible for unit Testing • Participate in Design and System Testing activities. • Manage data at scale using relational databases and SQL • Build best in class ETL based solutions for effective data ingestion and transformation • Work closely with the IT and platform teams to deliver tech solutions • Explore existing application systems, determines areas of complexity, potential risks to successful implementation Skills Required • Overall 3 years of experience in software development using Java • Atleast 2 years' experience in Spark technology ( along with Big Data platforms, RDBMS, NoSQL) • Advanced SQL capabilities are required. Knowledge of database design techniques and experience working with extremely large data volumes is a plus • Advanced experience in ETL and data wrangling using language Java • Experience in programing in Linux/Unix environment including shell scripting • Experience in Agile SDLC and AWS is a plus Educational Qualifications Master degree in Computer Science or Engineering or related discipline