Roles and Responsibilities

- Design, develop, test, deploy, and maintain scalable data pipelines using AWS services such as Glue, Lambda, and S3.

- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.

- Develop complex SQL queries to extract insights from large datasets stored in Postgres databases.

- Implement automation scripts using Python programming language to streamline tasks and improve efficiency.

- Troubleshoot issues related to data processing workflows and provide timely resolutions.

Desired Candidate Profile

- 6-10 years of experience in software development with a focus on big data technologies like Spark (Pyspark).

- Solid understanding of AWS ecosystem including Glue, Lambda functions, S3 buckets etc...

- Proficiency in writing complex SQL queries for querying relational databases like PostgreSQL.

- Experience with DevOps tools like Ansible or Terraform for infrastructure provisioning and management.

📌 Python Engineer (Hyderabad)
🏢 CGI
📍 Hyderabad