Job Title : Lead Data Engineer – GCP | Dataflow | Java | BigQuery

Experience: 7+ Years

Location: Chennai / Bangalore / Coimbatore

Work Mode: Hybrid

Contract: Long Term

We are looking for a highly skilled Lead Data Engineer with strong hands-on expertise in GCP, Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, developing, and optimizing scalable batch and real-time data pipelines for enterprise applications.

Key Responsibilities

- Design and develop scalable ETL/ELT pipelines using GCP services
- Build and maintain batch & real-time data processing pipelines using Dataflow and Apache Beam
- Develop robust backend processing solutions using Java
- Work extensively with BigQuery for data warehousing, analytics, and performance optimization




- Integrate data from APIs, databases, and streaming platforms
- Optimize pipelines for performance, cost, scalability, and reliability
- Collaborate with Architects, Analysts, DevOps teams, and Business stakeholders
- Ensure data quality, governance, monitoring, and security best practices
- Troubleshoot production issues and implement scalable long-term solutions

Must-Have Skills

GCP

Google Dataflow / Apache Beam

Java

BigQuery

Batch & Streaming Data Pipelines

SQL

Data Modeling

CI/CD

Git

Agile Methodologies

Robust Problem-Solving & Debugging Skills

📌 Lead Data Engineer – GCP | Dataflow | Java | BigQuery (Bangalore Metropolitan Area)
🏢 RapidBrains
📍 Bangalore Metropolitan Area