- Design, develop, and optimize scalable data engineering solutions using Databricks .
- Build high-performance applications and pipelines using Apache Spark/PySpark .
- Lead legacy-to-Databricks/Spark migration initiatives.
- Design and implement production-grade ETL/ELT and data integration frameworks .
- Design modern Lakehouse architectures using Delta Lake and Unity Catalog .
- Implement data governance, security, scalability, and performance optimization practices.
- Work across AWS, Azure, or GCP cloud environments.
- Develop and automate CI/CD pipelines for data engineering deployments.
- Troubleshoot complex production issues and optimize Spark/Databricks workloads.
- Collaborate with customers, architects, engineering teams, and other stakeholders to deliver enterprise data solutions.
- Contribute to emerging GenAI, RAG, MLOps,
and AI-driven data engineering initiatives.
Mandatory Skills
- 10+ years of overall IT experience with 7+ years in Data Engineering .
- Strong hands-on experience with Databricks .
- Expert-level knowledge of Apache Spark and PySpark .
- Experience delivering 4–5+ Spark/Data Migration projects .
- Experience with multiple Databricks implementations (ideally 6–8) .
- Strong experience with at least one cloud platform: AWS, Azure, or GCP .
- Strong knowledge of Data Architecture and Data Integration .
- Hands-on experience with Delta Lake and Unity Catalog .
- Strong Python and SQL skills.
- Experience with CI/CD tools such as Azure DevOps, Jenkins, Git, Terraform, etc.
- Solid production support, troubleshooting, and performance optimization experience.
- Databricks Professional Certification is preferred.
📌 Senior FDE (Pune)
🏢 Talentmatics
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.