This is Hybrid role .Job Locations:

Bengaluru, India / Noida, India / Pune, India / Gurgaon, India / Mumbai, India

Skills Required

Primary Skills

Databricks and PySpark; Advanced SQLmedallion/lakehouse; Data vault 2.0

Job Description

Key Responsibilities

• Own end-to-end technical design of lakehouse pipelines and frameworks: ingestion patterns, medallion layer standards, metadata-driven frameworks, reusable libraries, and naming/coding conventions.

• Lead and grow a squad of data engineers (typically 5–10): task breakdown and estimation, sprint planning with the Scrum Master/EM, code reviews, pairing, and performance feedback.

• Translate business and architecture requirements into technical designs and delivery plans; present and defend design decisions and trade-offs to QBE architects and platform owners.

• Set and enforce engineering quality gates: PR review standards, unit/integration test coverage for pipelines, data quality SLAs, CI/CD promotion criteria, and documentation.

• Own non-functional outcomes — performance, cost optimisation (cluster/DBU governance),



security (Unity Catalog permissions, PII handling), reliability, and observability of the platform.

• Manage technical risk: dependency tracking, proof-of-concepts for recent patterns (streaming, DLT, Asset Bundles), remediation plans for tech debt, and production incident command for critical issues.

• Coordinate across workstreams — Data Modelers, BDAs, testing, governance — to keep specs, models, code, and test coverage in lockstep; run design authority sessions.

• For the Onshore Lead: front-door for client stakeholders — requirement workshops, steering-committee technical inputs, escalation handling, and onshore–offshore handshake quality.

• For the Offshore Lead: run offshore ceremonies, own sprint delivery and status, ensure overlap-hours coverage, and manage the offshore–onshore work packaging.

Must-Have Skills & Experience

• 12+ years in data engineering with 5+ years leading tea

📌 Data Engineering Lead (India)
🏢 Sparix Global
📍 India