">Lead Data Engineer

9-11 Years Bengaluru, Noida, Pune

- Data Engineer

Position Overview - We are looking for a Lead Data Engineer to drive the design and delivery of enterprise data engineering solutions for clients. The role combines strong hands-on engineering with technical leadership, solution design, client interaction, and team guidance.

Key Responsibilities-

Lead the architecture, design, and implementation of scalable data platforms and pipelines.

Translate client and business requirements into data architecture and technical solutions.

Design batch, streaming, warehouse, data lake, and Lakehouse solutions.

Guide implementation using PySpark, SQL, Snowflake, Databricks, and cloud-native data services as appropriate.

Define engineering standards for data quality, testing, CI/CD, observability, performance, and production reliability.

Review technical designs, data models, code, and pipeline implementations.

Lead troubleshooting of complex production, scalability, and performance issues.

Mentor data engineers and provide technical direction to project teams.

Participate in client workshops, solutioning, estimations, technical proposals, and implementation planning.

Mandatory Skills -

9+ years of data/software engineering experience with technical lead responsibilities.

Strong hands-on expertise in PySpark and SQL.





Strong understanding of data architecture, ETL/ELT, data modelling, data warehousing, distributed processing, and batch/streaming patterns.

Experience designing and delivering large-scale production data pipelines.

Strong experience with at least one major cloud platform - AWS, Azure, or GCP.

Hands-on experience with modern data platforms, with depth in at least one of Snowflake, Databricks, BigQuery,

Redshift, Synapse, or equivalent.

Experience with CI/CD, testing, monitoring, observability, and production support.

Robust client-facing communication and technical solutioning skills.

Preferred Skills -

Strong experience with Snowflake and/or Databricks.

Experience with Kafka, Flink, Kinesis, Event Hub, Pub/Sub, or similar streaming platforms.

Experience with Parquet, Delta Lake, or Iceberg.

Experience with Airflow, ADF, AWS Glue, Cloud Composer, dbt, or equivalent tooling.

Experience with cloud migration, data modernization, governance, metadata, or lineage initiatives.

Experience in IT services, presales, estimation, or proposal support.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Lead Data Engineer (Pune)
🏢 Quarks Technosoft
📍 Pune