Description

Responsibilities
Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks
Create build from Github and release pipeline and Databricks using Azure Devops / Harness
Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
Diagnose system performance issue related to data processing and implement solution to address
Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
Maintain integrity and quality across all pipelines and environments.
Understand and follow secure coding practice to make sure code is not vulnerable

Responsibilities

Responsibilities
Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks
Create build from Github and release pipeline and Databricks using Azure Devops / Harness
Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
Diagnose system performance issue related to data processing and implement solution to address




Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
Maintain integrity and quality across all pipelines and settings.
Understand and follow secure coding practice to make sure code is not vulnerable

Qualifications

Skills
Should have Robust background in Software development with experience in ingest, transform and store data from large datasets using SQL with robust knowledge on distributed computing concepts.
Must have hands on experience in designing and developing Data Transformation Logic using SQL
Must have hands on Experience with Databricks.
Must have minimum 5 years of exposure and good proficiency in data warehousing concepts.
Extensive experience writing, optimizing, and data pipelines.
Proficient in SQL and database Design concepts.
Knowledge of Azure cloud computing platform with Azure Synapse, ADLS
Knowledge on GitHub and build management.
Passion for data and experience working within a data driven organization
Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management

📌 Btl / Etl Data Engineer Sql / Dbt In Azure Databricks Gurugram
🏢 Important Business
📍 Gurugram