15 Oct
|
Duobridge
|
Bengaluru
15 Oct
Duobridge
Bengaluru
Job Description
We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.
Key Responsibilities
• Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.
• Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.
• Implement containerisation and deployment using Docker and Kubernetes.
• Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.
• Ensure data quality, governance, monitoring, and performance optimisation.
Required Skills
AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins.
Note: Candidates must be comfortable working from the Bangalore office 4 days a week.
Skills: terraform,python,sql,aws kinesis,kafka,git,spark,docker,aws,snowflake,jenkins,ckad,databricks,airflow
📌 Data Engineer (Bengaluru)
🏢 Duobridge
📍 Bengaluru