Job Requirements

JD: Position: Databricks & Azure Synapse / MS Fabric Data Engineer – Senior Consultant

At least 6 years of experience as a Databricks & Data Engineer, with demonstrated experience designing and implementing data solutions using Azure services such as Azure Data Factory, Synapse Pipelines, Data

Flows, Azure SQL Database, Azure Databricks, Azure Cosmos DB, and Microsoft Fabric Lakehouse /

Warehouse solutions.

Strong experience with Python programming and have a good understanding of relational database concepts.

Proficient in SQL and experience with Dimensional data modeling, Data warehousing, and ETL processes.

Develop and optimize data pipelines using Azure Databricks and Synapse Pipelines, ensuring efficient processing of large-scale datasets.

Utilize Apache Spark on Databricks to perform real-time and batch data processing, enabling robust and scalable data analytics.

Integrate diverse data sources into Fabric One-Lake / Databricks Lakehouse / Azure Data Lake Storage using Azure Data Factory and Data Flows, ensuring data is readily available for analysis.

Architect and maintain data solutions with Delta Lake on Databricks or Delta tables in Fabric One Lake,





ensuring high data quality, consistency, and accessibility.

ly integrated into data pipelines.

Automate and manage CI/CD pipelines using Azure DevOps, focusing on Databricks notebooks, Synapse artifacts, and Fabric workflows.

Establish data governance and security using Azure Purview and Databricks Unity Catalog to ensure compliance and data integrity across platforms.

Monitor, optimize, and fine-tune performance in Databricks, Synapse, and Fabric environments to maintain high efficiency and cost-effectiveness.

Develop and maintain creative, cost effective yet scalable and highly performing Azure Data solutions

(leveraging server-less SQL pool, data flows, Apache Spark pool, Dedicated SQL Pools)

Expert level understanding on Azure Data Factory, Azure Synapse Pipelines, Data Flows, Azure SQL, Azure

Data Lake Gen2 and other relevant Azure App Service is required.

Ability to create and maintain Data flow, ETL Specifications documentation, including data dictionaries and technical specifications.

Work Experience

7-10Years

📌 Lead Software Engineer (Hyderabad)
🏢 Virtusa
📍 Hyderabad