Job highlights

- 5-8 years in data engineering with Python, expertise in AWS (S3, Lambda, Step Functions), Fast API development, and PySpark

- Design, develop, test, and deploy scalable data pipelines; develop Rapid APIs; integrate PySpark applications; troubleshoot pipeline issues

Roles and Responsibilities

- Design, develop, test, and deploy scalable data pipelines using AWS services such as S3, Lambda, Step Functions.

- Develop high-quality code in Python with expertise in Fast API development.

- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.

- Ensure seamless integration of PySpark applications with other systems through effective communication and collaboration.





- Troubleshoot issues related to pipeline failures or errors by analyzing logs, debugging techniques.

Desired Candidate Profile

- 5-8 years of experience in software development with a focus on data engineering using Python programming language.

- Strong understanding of AWS ecosystem including S3, Lambda functions, Step Functions etc. .

- Proficiency in developing fast APIs using Python frameworks like Flask or Django.

- Experience working with big data technologies like Spark (PySpark) for data processing tasks.

📌 Python developer (Hyderabad)
🏢 CGI
📍 Hyderabad