Job Title: Senior Data Engineer JD (Python, Airflow, Kafka, REST APIs, SQL/PLSQL)

Position: Senior Data Engineer

Experience: 7-10+ yrs of exp on above skills

Category: Data Engineering

Shift: Hybrid - (1PM to 10 PM Shift)

Main location: Hyderabad

Position ID: J0426-1134

Employment Type: Full Time

Education Qualification:

- Bachelor's degree in Computer Science or related field or higher with minimum 7 -10+ years of relevant experience.

Position Description:

- We are looking for a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines.
- The ideal candidate will have strong experience in ETL/ELT processes, workflow orchestration using Apache Airflow, cloud data platforms (AWS S3), and big data processing using Python.
- You will be responsible for handling data ingestion from multiple sources such as REST APIs, SFTP/FTP, flat files, and databases, ensuring high data quality, reliability, and performance.

Your future duties and responsibilities:

- Design scalable batch and streaming architectures

- Develop advanced Airflow DAGs with dynamic task mapping

- Build robust REST API ingestion pipelines

- Implement Kafka producers/consumers

- Write and optimize SQL/PLSQL queries and data models for transformations

- Ensure data quality,



monitoring, and reliability - Error handling, fault tolerance.

- Data triaging

- Ensure idempotent and incremental data loads

- Api rate limits and retries at scale

Required qualifications to be successful in this role:

- 7-10+ years of experience in Data Engineering

- Solid Python programming

- Expertise in Apache Airflow, DAG Coding, Kafka

- Experience with REST API integrations

- Advanced SQL and PL/SQL knowledge

- Experience handling large-scale data pipelines

- Cloud Platforms (AWS/GCP/Azure)

Good to Have

- Oracle database knowledge

- Exposure to CI/CD pipelines and containerization (Jenkins/ Git/ Docker/Kubernetes)

- Exposure to data governance and compliance frameworks CGI is an equal opportunity employer.

In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation.

Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs. #LI-SP40

Skills:

- Agile
- Airflow
- ETL
- Python
- Requirements Analysis
- Snowflake
- SQL
- Web Services

📌 Data Engineer (API, ETL, PySpark, Airflow & Kafka) (Telangana)
🏢 CGI
📍 Telangana