12 Sep
|
Tata Consultancy Services
|
Kolkata
12 Sep
Tata Consultancy Services
Kolkata
Job title: Azure Databricks
Experience Range: 4 - 10 years
Walkin Drive Location: Tata Consultancy Services Limited, Gitanjali Park.
IT/ITES SEZ, Plot-IIF / 3, AA II, Newtown, New Town, West Bengal 700160
Required Skill Set:Data Lake architecture, Azure Services ADLS, ADF, Azure Databricks, Synapse
ADF, ADB, SQL, Pyspark, python
Good Knowledge of Data Brick lake house and Azure Data Lake concept - Knowledge of Data Bricks delta concept
Delta live tables (DLT) -
Strong hands-on experience in ELT pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task -
Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic -
In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool. -
Experience with data transformation using Spark, and SQL technologies.
- Solid understanding of design patterns, and best practices of the cloud stack. -
Experience with code management and version control using Git or similar tools. -
Strong problem-solving and debugging skills in ETL workflows and data pipelines. -
Robust understanding of Azure Data bricks and Azure Synapse internals features and capabilities. -
Knowledge of Azure DevOps and continuous integration and deployment (CI/CD) process. -
Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing.
Location
- Kolkata
Job Function
- TECHNOLOGY
Role
- Engineer
Job Id
- 403796
Desired Skills
- Azure | Python | Spark | SQL
Qualifications : BACHELOR OF ENGINEERING, BACHELOR OF TECHNOLOGY
📌 Databricks (Kolkata)
🏢 Tata Consultancy Services
📍 Kolkata