06 Aug
|
HCL Technologies
|
India
06 Aug
HCL Technologies
India
Azure Senior Data Lead
Experience: 10 to Not Available years
Location: Nagpur, India
Skills: Databricks, Delta Lake, Google Cloud Platform, Apache Spark, structured streaming, ELT patterns, Unity Catalog
Job Summary
Role name: GCP + Data Bricks Architect. Responsibilities: Architect and implement scalable Lakehouse data platforms using Databricks and Delta Lake. Architect integrations and migrations from Google Cloud Platform to Databricks on GCP. Design robust batch and streaming data pipelines leveraging Apache Spark, structured streaming, and up-to-date ELT patterns. Lead migration of Jobs from other cloud data platform to Databricks. Implement secure data governance, access control, and lineage using Unity Catalog.
Optimize performance and manage compute costs through effective cluster configuration and Spark workload tuning. Collaborate with data engineers, analytics teams, and ML engineers to enable scalable data products and analytics. Define best practices for data quality, reliability, and observability across the data platform. Provide technical leadership, architecture guidance, and mentorship to data engineering teams.
Key Responsibilities
null
Skill Requirements
null
Other Requirements
null
📌 Azure Senior Data Lead Nagpur (India)
🏢 HCL Technologies
📍 India