22 Sep
|
systems plus
|
India
22 Sep
systems plus
India
Location: Pune Employment Type: full-time
Job Details
Key Responsibilities & Skills
- Solid hands-on experience in Azure Databricks, Apache Spark, PySpark and SQL.
- Strong understanding of Delta Lake, Medallion Architecture, ETL/ELT pipelines and modern data engineering practices.
- Experience in designing, developing and supporting scalable data pipelines and data processing workloads on Databricks.
- Strong experience in performance tuning, optimization and troubleshooting of Spark jobs, clusters and data pipelines.
- Experience in handling production support, complex incidents, root cause analysis and problem management in Databricks/Data Platform environments.
- Ability to provide technical leadership and architectural guidance for the Databricks and overall Data Platform landscape.
- Strong knowledge of Azure Data Factory, Azure Data Lake Storage and related Azure Data Services.
- Experience in integrating Databricks with enterprise data warehouses, databases and upstream/downstream applications.
- Good understanding of data warehousing,
dimensional modeling and enterprise data integration concepts.
- Experience in code review, release management, deployment and production readiness activities.
- Ability to support minor enhancements, continuous improvements and ongoing platform modernization initiatives.
- Experience in leading technical discussions, mentoring engineers and guiding teams on complex technical issues.
- Ability to work directly with client stakeholders and technical teams on priorities, issues and technical decisions.
- Strong communication and stakeholder management skills, with the ability to work independently in a client-facing environment.
- Willingness to provide support during US business hours, including availability for critical production issues as required.
- Experience in retail or a similar data-intensive enterprise environment.
- Experience with legacy EDW/SQL Server environments is an added advantage.
📌 Databricks Technical Lead (India)
🏢 systems plus
📍 India