A Lead Data Engineer 7+years of experience is responsible for designing, building, and overseeing an organization’s data infrastructure and engineering strategy. The role combines hands-on technical expertise with architecture, mentorship, and cross-functional leadership.

Core Responsibilities
Design scalable data platforms and pipelines
Lead ETL/ELT architecture and orchestration
Own data warehousing/lakehouse strategy
Ensure data quality, governance, and reliability
Optimize performance and cloud costs
Mentor data engineers and establish standards
Collaborate with analytics, ML, and product teams
Drive CI/CD, observability, and platform automation

Common Tech Stack
Languages: Python, SQL, Scala, Java
Big data: Spark, Kafka, Flink
Cloud: AWS, Azure, GCP
Warehouses: Snowflake, BigQuery,



Redshift, Databricks
Orchestration: Airflow, Dagster, Prefect
Infrastructure: Terraform, Kubernetes, Docker
Data modeling: dbt, dimensional modeling, Data Vault

Typical Skills ExpectedAreaExamplesData ArchitectureLakehouse, medallion architectureDistributed SystemsSpark tuning, partitioningStreamingKafka, event-driven pipelinesDevOps/DataOpsCI/CD, IaC, observabilityLeadershipMentoring, roadmap planningGovernanceSecurity, lineage, compliance

Pay: ₹2,500,000.00 - ₹4,000,000.00 per year

Perks:
Paid sick time
Provident Fund

Work Location: In person

📌 Lead Data Engineer Bengaluru
🏢 Rubikssyslabs
📍 Bengaluru