Lead Data Engineer (Bengaluru)

Lead Data Engineer (Bengaluru)

16 Nov
|
LeadSquared
|
Bengaluru

16 Nov

LeadSquared

Bengaluru

Role overview

We are hiring a Lead Data Engineer with 4–6 years of experience to own the data pipelines behind ACE, our sales performance suite. You will design, build and run the batch and streaming pipelines that turn raw data into reliable, analytics-ready datasets, and guide a small team of data engineers while doing it.

About ACE

ACE is our sales performance suite. It helps sales teams track, analyze and improve performance, and every view it offers depends on timely, accurate data flowing in from many sources. In this role you will shape how that data is ingested, processed and served as ACE grows.

Key responsibilities

- Design, build and maintain scalable batch and real-time data pipelines that feed ACE.
- Develop ETL/ELT workflows in Python and PySpark to ingest, clean, transform and model large datasets.
- Build and operate streaming pipelines on Kafka, including topic design, producers, consumers and schema handling.
- Orchestrate, schedule and monitor workflows with Apache Airflow, including DAG design, retries and alerting.
- Own data quality, with validation checks, reconciliation and clear handling of late or bad data.
- Tune Spark jobs and pipelines for performance, reliability and cost.
- Lead and mentor a small team of data engineers through code reviews, design reviews and pairing.
- Work with product managers, analysts and backend engineers to turn ACE requirements into data models and pipelines.
- Set engineering standards for testing,



CI/CD, documentation and observability of data pipelines.
- Troubleshoot production issues and drive root-cause fixes.

Required skills and qualifications

- 4–6 years of hands-on experience in data engineering.
- Proven experience building data pipelines and ETL pipelines in production.
- Robust Python programming skills.
- Hands-on experience with PySpark for large-scale data processing.
- Practical experience with Kafka for real-time or event-driven data streaming.
- Experience building and managing workflows in Apache Airflow.
- Strong SQL and a solid grasp of data modeling (dimensional models, fact and dimension tables).
- Experience with at least one cloud platform (AWS, Azure or GCP) and its data services.
- Experience leading or mentoring engineers, or acting as technical lead on a project.
- Bachelor’s degree in Computer Science, Engineering or a related field, or equivalent experience.

Nice to have

- Experience with data warehouses or lakehouses such as Snowflake, BigQuery, Redshift or Databricks (Delta Lake).
- Familiarity with Spark Structured Streaming or Kafka Streams.
- Experience with dbt or similar transformation tooling.
- Exposure to Docker, Kubernetes and infrastructure-as-code (e.g. Terraform).
- Background working on sales performance, CRM, analytics or BI products.
- Knowledge of data governance, lineage and access control.

📌 Lead Data Engineer (Bengaluru)
🏢 LeadSquared
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (bengaluru) / bengaluru