Chennai, Tamil Nadu
Job Summary The Senior Technical Specialist will be responsible for creating, overseeing and managing ETL Pipelines, Azure Databricks, SQL, Pyspark. The primary objectives include optimizing data workflows, ensuring data reliability and integrity, and developing effective data processing solutions using Azure technologies.
Key Responsibilities
Design, develop, and implement data pipelines using azure data factory (adf) or similar to extract, transform, and load data.
Utilize azure databricks to process and analyze large volumes of data efficiently.
Write complex sql queries to extract and manipulate data for reporting and analysis purposes.
Develop and maintain Pyspark scripts for data processing and automation tasks.
Collaborate with cross functional teams to troubleshoot data related issues and optimize data processes.
Stay updated on the latest azure technologies and recommend cutting-edge solutions to improve data workflows.
Skill Requirements
Proficiency in building and scheduling ETL data pipelines.
Experience with azure databricks for processing big data workloads.
Robust skills in writing sql queries for data extraction and manipulation.
Proficient in Pyspark scripting for data processing and automation tasks.
Problem-solving skills with the ability to analyze complex data systems and processes.
Strong communication and teamwork abilities to collaborate effectively with different teams and stakeholders.
Other Requirements
1.Relevant certifications in Azure Data Factory (ADF), Azure Databricks, SQL, Pyspark are a plus.
body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-
📌 Azure Senior Data Technical Specialist Chennai (India)
🏢 HCLTech
📍 India