We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.

Key Responsibilities

- Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.
- Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.
- Implement containerisation and deployment using Docker and Kubernetes.
- Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.
- Ensure data quality, governance, monitoring, and performance optimisation.

Required Skills AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins. Note: Candidates must be comfortable working from the Bangalore office 4 days a week.

Skills: terraform,python,sql,aws kinesis,kafka,git,spark,docker,aws,snowflake,jenkins,ckad,databricks,airflow

📌 Data Engineer - Bangalore (Bengaluru)
🏢 Duobridge
📍 Bengaluru