Role : Sr. Data Engineer / Lead Data Engineer / Databricks Architect

Experience: 9 -12 Years / 12+ years for both (Lead Data Engineer / Databricks Architect )
Location: Hybrid [Pune, Gurugram, Bangalore, Noida, Hyderabad, Chennai]

Must-Have Skills & Experience

Sr. Data Engineer Job Description

- 912 years overall; strong recent hands-on Databricks and PySpark delivery experience (3+ years Databricks preferred).
- Expert-level Spark (DataFrame API, Spark SQL, window functions, UDF trade-offs) and advanced Python for data engineering.
- Advanced SQL complex transformations, performance tuning, analytical/window queries on large volumes.
- Delta Lake internals and medallion/lakehouse architecture in production.
- Azure data stack: ADLS Gen2, Azure Data Factory, Key Vault, and Databricks administration basics (clusters, pools, jobs, secrets).
- Data warehousing concepts: star schemas, fact/dimension loading patterns, SCD handling, reconciliation.
- Git-based SDLC with CI/CD exposure (Azure DevOps or GitHub).
- Insurance or financial-services data experience ideally P&C; (policy/claims/premium/reinsurance structures).

Lead Data Engineer Job Description

- 12+ years in data engineering with 5+ years leading teams delivering on Spark platforms; deep, current hands-on Databricks + PySpark (this is a coding lead, not a pure people-manager role).
- Proven architecture-level command of the lakehouse/medallion pattern, Delta Lake,



Unity Catalog, and Azure data services (ADLS Gen2, ADF, Key Vault, networking basics for Databricks).
- Track record designing metadata/config-driven ingestion and transformation frameworks used by multiple teams.
- Advanced Spark performance engineering and cost governance at platform scale.
- Solid SDLC leadership: Git branching strategy, CI/CD (Azure DevOps/GitHub Actions), environment strategy, release management.
- Insurance domain experience P&C; strongly preferred (policy, claims, premium, reinsurance, actuarial data flows).
- Experience running distributed onshore/offshore delivery models with measurable quality outcomes.

Databricks Architect Job Description

- 12+ years experience with a strong Data Engineering background (ETL/ELT, distributed compute, production-grade pipelines).
- 5+ years hands-on Databricks experience in architecture/technical leadership roles.
- Strong experience in Apache Spark (PySpark/Scala), Delta Lake, pipeline design, and performance tuning.
- At least 1 Databricks Certification.
- Experience with data orchestration and DevOps practices (Git, CI/CD, testing frameworks).
- Experience designing secure data platforms (RBAC, secrets, network/security integration, compliance considerations).
- Strong customer-facing skills: requirements discovery, solution design, and stakeholder management.

📌 Lead Data Engineer (Pune)
🏢 Wipzo Systech
📍 Pune