The Technical Lead will drive the migration of our Microsoft-based data platforms (on-premise and Azure) to Databricks, providing hands-on mentorship and technical oversight for the data engineering team.

Please note: This is a pure technical leadership role, focused on architecture and execution rather than project management or Scrum facilitation.

The focus is on:

Technical directionEngineering qualityDelivery executionRemoving technical blockersEnsuring consistency and scalability across teams

The Technical Lead will act as the bridge between architecture, engineering teams, and delivery, while remaining capable of hands-on contribution when needed.

Key Responsibilities

Technical Leadership & Coordination

Act as the technical reference point for data engineers during migration and transformation activitiesBreak down high-level migration objectives into clear technical tasks and implementation approachesEnsure alignment to target architecture and standards (Databricks, cloud-native patterns)Review designs, pipelines, and implementations to ensure quality and consistencyActively remove technical blockers for the engineering teams

Migration & Transformation Execution

Lead the migration of data pipelines from:o SQL Server / SSIS (on-prem)

o Azure Synapse

o Azure SQL / SQL Managed Instances→ into Databricks (Lakehouse architecture)

Define and enforce best practices for:o Data ingestion

o Transformation patterns

o Performance optimization

o Cost awareness

Support coexistence scenarios during the transition phase

Hands-on Engineering (as needed)





Contribute directly to development when required:Databricks notebooks (PySpark / SQL)Ingestion pipelinesRefactoring legacy logicBuild reference implementations and examples for the teamSupport troubleshooting and performance tuning

Team Enablement

Mentor data engineers and help upskill them towards Databricks and modern data engineering practicesFacilitate technical discussions, refinement sessions, and solution reviewsEnsure development stays on track, even across multiple parallel workstreamsWhat This Role Is NOT

Not a Project ManagerNot a Scrum MasterNot a pure ArchitectNot 100% hands-on developerIt is a delivery-focused technical leadership role.

Required Technical Skills

Core Platform Knowledge

Robust experience in Data EngineeringProven experience leading engineers in complex data environmentsHands-on experience with:Databricks (mandatory)PySpark & Spark SQLLakehouse concepts (Bronze / Silver / Gold)Microsoft & Azure Background (must-have due to migration context)

Solid experience with:SQL ServerAzure SQL / SQL Managed InstancesAzure SynapseAbility to translate legacy ETL logic into modern Spark-based pipelinesCloud & Engineering Practices

Experience with Azure cloud environmentsUnderstanding of:CI/CD for data pipelinesGit-based developmentInfrastructure-as-code concepts (nice to have)Strong SQL skillsPerformance tuning and troubleshooting experience

Qualifications

Bachelor’s or Master’s degree in Computer Science, or a strictly related technical discipline.

7-10 years of specialized experience in Data Engineering.

Preferred background in the Retail sector, with an understanding of industry-specific data challenges.

Technical Leadership

Lead the DE Team/Owning the DE tasks (Design, build, maintain entire pipelines)

Data quality/Integrity/availability across the system

📌 Data Engineering Technical Lead (Mumbai)
🏢 Texplorers
📍 Mumbai