18 Nov
|
Aarquench Solutions Private
|
Bengaluru
18 Nov
Aarquench Solutions Private
Bengaluru
Job Description
Job Details
- Job Title: Lead Data Engineer – GCP | Dataflow | Java | BigQuery
- Experience: 7–10 Years
- Open Positions: 2
- Job Type: Contract
- Contract Duration: 3–6 Months
- Work Mode: Hybrid
- Job Locations: Chennai | Coimbatore | Bengaluru | Pune
- Expected Start Date: 23 November 2026
Job Description
We are looking for an experienced Lead Data Engineer with strong hands-on expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate should have experience designing, developing, and optimizing scalable data pipelines and cloud-based data processing solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using GCP services.
- Build real-time and batch data processing pipelines using Google Dataflow and Apache Beam.
- Develop backend data processing solutions using Java.
- Work extensively with BigQuery for data warehousing, analytics, and query optimization.
- Integrate data from multiple sources, including APIs, databases, and streaming platforms.
- Optimize data pipelines for performance,
scalability, cost, and reliability.
- Ensure data quality, security, monitoring, and governance.
- Troubleshoot production issues and implement scalable solutions.
- Collaborate with architects, analysts, DevOps teams, and business stakeholders.
Required Skills
- Solid hands-on experience with Google Cloud Platform (GCP).
- Expertise in Google Dataflow and Apache Beam.
- Strong programming skills in Java.
- Hands-on experience with BigQuery.
- Experience building batch and streaming data pipelines.
- Good knowledge of SQL and data modeling.
- Experience with Git, CI/CD, and Agile methodologies.
- Strong problem-solving and debugging skills.
Good to Have
- Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.
- Exposure to Python or Apache Spark.
- Experience working with large-scale enterprise data platforms.
- GCP certifications will be an added advantage.
- If interested click 'Apply
📌 Lead Data Engineer – GCP | Dataflow | Java | BigQuery (Bengaluru)
🏢 Aarquench Solutions Private
📍 Bengaluru