- AWS Certifications
- Experience with large-scale data processing
- CI/CD, Automation, and Testing frameworks
Key Responsibilities
- Design, develop, and maintain scalable data transformation pipelines using AWS services (Lambda, Step Functions) and Python.
- Build and optimize data processing workflows using PySpark and Databricks.
- Design and maintain complex data calculation and transformation engines.
- Manage and process large-scale datasets efficiently.
- Develop and support SQL databases including PostgreSQL and MongoDB.
- Collaborate closely with Software Engineering teams on solution design and implementation.
- Participate in code reviews, architecture discussions, and software planning activities.
- Contribute to automation, testing, deployment, and continuous improvement initiatives.
Desired Profile
- Strong hands-on experience with AWS Data Engineering services.
- Expertise in Python, PySpark, Databricks, and SQL.
- Excellent problem-solving and analytical skills.
- Solid communication, collaboration, and documentation skills.
- Ability to work effectively in agile and cross-functional teams.