Job Title: Big Data Lead

Experience: 812 Years
Location: Pune

Role

We are looking for a Big Data Lead with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP, modernizing on-premise workloads, and guiding technical teams to deliver robust and scalable solutions.

Key Responsibilities
Architect contemporary data platforms on GCP using BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Composer, GCS.
Lead data modernization and migration programs from on-premise systems (Teradata, Netezza, Exadata, Hadoop) to GCP.
Define end-to-end solution architectures including data ingestion, storage, transformation, governance, and analytics.
Establish best practices for scalability, security, compliance, lineage, and cost optimization.
Collaborate with business stakeholders and solution teams to align technical architectures with business outcomes.




Mentor teams, conduct design reviews, and ensure architecture standards are met across multiple projects.

Required Skills
Big Data Architecture Expertise: Hands-on design and delivery experience with Hadoop, Hive, Spark (Scala/PySpark), SQL, Oozie, Sqoop, Impala, Flume.
GCP Specialization: Solid expertise in BigQuery, Dataproc, Dataflow, Pub/Sub, GCS, Cloud Composer.
Programming & Scripting: Proficiency in Scala, Python, Java, and shell scripting.
Data Governance: Deep knowledge of metadata, lineage, auditing, business glossary, SCD implementations.
CI/CD & DevOps: Experience with Git/Bitbucket, Jenkins, Terraform/Deployment Manager.
Leadership: Proven ability to design reference architectures, guide delivery teams, lead customer workshops, and influence decision-making.

📌 Big Data Lead Pune (India)
🏢 Datametica
📍 India