Senior Data Engineer - Databricks Migration

Experience 7+ Years

Location - Kochi, Chennai, Coimbatore, Mumbai, Pune

Employment Type -Full Time

Project Context Migration from legacy data technologies to DatabricksCore Skills Databricks, PySpark, T-SQL interpretation, ETL/ELT, Data Engineering
Role Summary
We are looking for a Senior Data Engineer with deep hands-on expertise in Databricks, PySpark, and legacy data migration. Thecandidate must have worked consistently as a Data Engineer throughout their career and should bring strong experience acrosstraditional data platforms such as Oracle, SQL Server/T-SQL, ETL, and Data Warehousing before moving into modern Databricksbased Data Engineering. This role requires strong ownership in interpreting complex legacy T-SQL logic, defining migrationapproaches, guiding engineering execution, and building scalable Databricks solutions.Important screening criterion: The candidate must have worked predominantly and consistently as a DataEngineer throughout their career. Profiles that are primarily BI, reporting, dashboarding, analytics, or only recentlyshifted into data engineering should not be prioritized.
Roles & Responsibilities• Lead the analysis and migration of legacy SQL, ETL, Data Warehouse, and T-SQL based workloads to Databricks.• Assess complex T-SQL scripts, stored procedures, functions, views, dependencies, and transformation logic for modernization.• Design scalable Databricks and PySpark solutions aligned to migration strategy and enterprise data architecture standards.• Translate legacy business logic into optimized PySpark, Spark SQL, Delta Lake, and Databricks workflows.• Create reusable frameworks, patterns,



and best practices for migration from legacy platforms to Databricks.• Provide technical guidance to mid-level Data Engineers and review migration deliverables for quality and performance.• Collaborate with architects, stakeholders, business users, and delivery teams to define migration roadmaps and source-to-targetmappings.• Drive performance tuning, workload optimization, debugging, and scalability improvements across Databricks workloads.• Ensure data quality, reconciliation, governance, security, and production readiness throughout the migration lifecycle.• Support estimation, planning, risk identification, documentation, and technical decision-making for the program.• Mentor team members and help establish strong Data Engineering practices across the project.
Must Have Skills• 7+ years of relevant Data Engineering experience, with a consistent Data Engineering career path.• Expert-level hands-on experience with Databricks.• Strong PySpark expertise for enterprise-scale data processing and transformation.• Advanced SQL/T-SQL understanding, with strong ability to read, analyze, and interpret legacy T-SQL implementations.• Experience in migration or modernization from legacy SQL/ETL/Data Warehouse platforms to Databricks or modern cloud dataplatforms.• Strong background in SQL Server, Oracle, ETL tools, Data Warehousing, or similar legacy data ecosystems.• Strong understanding of Data Modeling, Data Warehousing, Delta Lake concepts,



and batch processing patterns.• Experience designing and optimizing scalable ETL/ELT pipelines.• Strong performance tuning and troubleshooting skills in Spark/Databricks environments.• Ability to guide engineering teams, review code, and influence technical solutions.• Solid communication and stakeholder management skills.
Preferred Skills• Azure Data Factory and broader Azure Data Platform expertise.• Unity Catalog, data governance, lineage, and security exposure.• Azure Synapse Analytics experience.• CI/CD and DevOps practices for Data Engineering workloads.• Experience creating migration frameworks, accelerators, or reusable transformation patterns.• Databricks certification or Azure Data Engineer certification.• Agile delivery and technical leadership experience.
Qualifications• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.• Relevant certifications in Databricks, Azure Data Engineering, Cloud Data Engineering, or Data Architecture will be preferred.Ideal Candidate Profile / Screening Notes• Strong, hands-on Data Engineering background throughout career, not a partial or recent transition.• Started career in legacy database, SQL Server, Oracle, ETL, or Data Warehouse environments and later moved into modernData Engineering.• Can read, understand, and interpret T-SQL logic, stored procedures, views, and transformation flows for migration purposes.• Does not need to be primarily focused on writing fresh T-SQL code, but must be able to analyze existing T-SQL and convert thelogic to Databricks/PySpark.• Strong Databricks and PySpark experience with practical migration or modernization exposure.• Avoid profiles that are mainly BI Developers, Power BI Developers, Data Analysts, or reporting-only candidates

Interested candidate share the resume before share kindly review the JD

📌 Senior Data Engineer - Databricks Migration (Kochi)
🏢 FRobin Technologies
📍 Kochi