Job Title

Data Engineer (GCP, Orchestration, Streaming, and Data Platform)

Location – Chennai, Bangalore, Hyderabad.

NP - immediate

Exp 5yrs -16 yrs

Role Summary

We are looking for a Data Engineer to build and operate reliable, secure, and scalable data products across a modern GCP platform. You will work across orchestration pipelines, streaming/event-driven services, and cloud resource provisioning, with strong ownership of CI/CD, observability, and production readiness. The role sits at the intersection of data engineering and platform engineering, supporting business-critical transaction and payments insights use cases.

What You Will Do

1. Design, develop, and maintain production data pipelines using Airflow/Composer and cloud-native processing frameworks.
2. Build and optimize batch and real-time data flows using tools such as Dataflow/Beam, dbt-style transformations, and SQL-based analytics patterns.
3. Integrate event-driven data from Kafka and downstream systems ensuring schema and contract reliability.
4. Engineer and manage data stores and interfaces across BigQuery, Spanner, and related GCP services.
5. Collaborate with application/service teams building Quarkus/Spring Boot microservices that publish/consume domain data.
6. Contribute to infrastructure and environment provisioning practices aligned with Terraform/GitOps-style templates and standards.
7. Own release quality through pipelines, automated testing, Sonar quality gates, vulnerability controls, and artifact/image lifecycle management.
8. Support Kubernetes/Helm-based deployments, environment promotions (INT/PRE/PRD), and operational stability.
9. Implement and improve monitoring, logging, auditability, and rollback-safe deployment patterns.
10.



Strong foundations in distributed computing to handle large volumes of data.

Required Skills and Experience

1. Strong experience in data engineering on GCP (BigQuery, Dataflow, Cloud Storage, IAM, networking basics).
2. Hands-on orchestration experience with Airflow/Cloud Composer in multi-workplace deployments.
3. Solid understanding of streaming/event architectures (Kafka, retries, DLQ patterns, idempotency).
4. Proficiency in SQL and data modeling for analytics and operational reporting.
5. Experience with CI/CD tooling (Jenkins/Harness), code quality controls, and test automation practices.
6. Practical knowledge of Kubernetes and Helm for service and pipeline deployment.
7. Good software engineering foundations in Java and Python.
8. Familiarity with versioned schema/database change workflows (for example, Liquibase).
9. Strong troubleshooting skills across data, platform, and deployment layers.
10. Excellent collaboration and communication in cross-functional delivery teams.

Tech Stack in This Role GCP, Airflow/Composer, Dataflow/Beam, BigQuery, Spanner, Kafka, dbt, Java Spring Boot & Quarkus, Jenkins, Harness, Helm, Kubernetes, SonarQube, Nexus IQ, Liquibase, GitHub-based workflows, Dynatrace.

Skills required

GCP Data engineer

Dataflow, Cloud Storage, IAM, networking basics

DBT (Mandatory - Important skill)

BigQuery ( Mandatory - Important skill)

Airflow/Cloud Composer

Kafka, retries, DLQ patterns, idempotency

Proficiency in SQL and data modeling

CI/CD tooling (Jenkins/Harness), code quality controls, and test automation practices

Practical knowledge of Kubernetes and Helm for service and pipeline deployment.

software engineering foundations in Java and Python

Dynatrace, Spanner SonarQube, Nexus IQ,

Banking Domain (Good to have)

Apply on [email protected]

(phone hidden)

📌 GCP Data Engineer (Bangalore Metropolitan Area)
🏢 Live Connections
📍 Bangalore Metropolitan Area