Role & responsibilities

Job Summary

We are looking for an experienced AWS Python Data Engineer with hands-on expertise in Python, Kafka, and Databricks to develop and maintain scalable data engineering solutions in the healthcare domain. The ideal candidate should have experience building data pipelines, processing large datasets, and implementing reliable data integration solutions on AWS.

Roles & Responsibilities

1. Design, develop, and maintain scalable data pipelines using Python and AWS services.
2. Implement real-time data ingestion and streaming solutions using Apache Kafka.
3. Develop data processing workflows using Databricks, PySpark, and Spark SQL.
4. Integrate healthcare data from multiple sources while ensuring data quality, security, and reliability.
5. Optimize data pipelines for performance, scalability, and cost efficiency.
6. Collaborate with cross-functional teams to understand business requirements and deliver effective data solutions.
7. Follow healthcare data privacy, governance, and compliance requirements.

Preferred candidate profile

Must-Have Skills

- 37 years of experience in data engineering or backend data development.




- Solid programming skills in Python and experience with AWS services.
- Hands-on experience with Apache Kafka and event-driven data processing.
- Experience with Databricks, PySpark, and Spark SQL.
- Experience developing ETL/ELT pipelines and processing structured and semi-structured data.
- Knowledge of healthcare data, healthcare systems, or healthcare data integration.
- Strong understanding of SQL, data modeling, debugging, and performance optimization.

Good-to-Have Skills

- Experience with AWS S3, Lambda, Glue, Redshift, EMR, or Step Functions.
- Familiarity with healthcare standards such as HL7 and FHIR.
- Knowledge of healthcare data privacy and security practices, including HIPAA.
- Experience with CI/CD, Git, workflow orchestration, and data pipeline monitoring.
- Exposure to Delta Lake, data quality frameworks, and cloud-based data platforms.

Preferred Candidate Profile

- Strong analytical and problem-solving skills.
- Ability to work collaboratively in an agile setting.
- Willingness to work from the Hyderabad location.
- Valuable communication skills and the ability to manage multiple priorities.

📌 Aws Data Engineer (Hyderabad)
🏢 CGI
📍 Hyderabad