16 Aug
|
Important Business
|
Chennai
16 Aug
Important Business
Chennai
Job Title: Lead Data Engineer – GCP
Experience: 7-12 Years
Location: Chennai/Pune/Bangalore/Coimbatore
About the Company:
Our client is a fast-growing technology-driven organization focused on building scalable, cloud-based data platforms and contemporary analytics solutions. The company specializes in leveraging cutting-edge cloud technologies and data engineering practices to enable data-driven decision-making. With a strong focus on innovation, data quality, and governance, the organization fosters a collaborative and high-performance engineering culture.
Role Overview:
We are looking for a highly skilled Lead Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, developing, and optimizing scalable cloud-based data processing pipelines for enterprise-grade applications.
Key Responsibilities:
- Design and develop scalable ETL/ELT pipelines using GCP services.
- Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam.
- Develop robust backend processing solutions using Java.
- Work extensively with BigQuery for data warehousing, analytics, and performance optimization.
- Integrate data from multiple sources including APIs, databases, and streaming platforms.
- Optimize pipeline performance, cost, scalability, and reliability on GCP.
- Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders.
- Ensure data quality, governance, monitoring, and security best practices.
- Troubleshoot production issues and provide long-term scalable solutions.
Required Skills:
- Strong hands-on experience with GCP services.
- Expertise in Google Dataflow / Apache Beam.
- Strong programming skills in Java.
- Hands-on experience with BigQuery.
- Experience in building batch and streaming data pipelines.
- Good knowledge of SQL and data modeling concepts.
- Experience with CI/CD, Git, and Agile methodologies.
- Strong problem-solving and debugging skills.
Eligibility / Qualifications:
- Education: Bachelor’s degree in IT / Computer Science / Engineering / related field
📌 Lead Data Engineer (Chennai)
🏢 Important Business
📍 Chennai