- Expertise in Python, AWS services (S3, Lambda, EMR, DynamoDB), and Pyspark development
- Design, develop, and deploy scalable software and data pipelines; collaborate with teams; troubleshoot issues; participate in code reviews
The ideal candidate will have expertise in developing scalable and efficient software applications using Python, AWS services, and Pyspark.
Roles and Responsibility
- Design, develop, and deploy scalable and effective software applications using Python, AWS services, and Pyspark.
- Collaborate with cross-functional teams to identify and prioritize project requirements.
- Develop and maintain large-scale data processing pipelines using Pyspark and AWS services.
- Troubleshoot and resolve technical issues efficiently.
- Participate in code reviews and contribute to improving the overall quality of the codebase.
- Stay updated with industry trends and emerging technologies to enhance skills and knowledge.
Job Requirements
- Proficiency in Python programming language is mandatory.
- Experience with AWS services such as S3, Lambda, EMR, DynamoDB, etc., is required.
- Strong understanding of Pyspark development principles and practices is necessary.
- Excellent problem-solving skills and attention to detail are essential.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders is crucial.
- Strong analytical and critical thinking skills are highly valued.