The Senior Data Engineer is responsible for the design, development, administration, governance, and operational support of enterprise data platforms built on Databricks and Microsoft Fabric. This role combines deep data engineering expertise with platform administration capabilities to ensure scalable, secure, reliable, and cost-effective data solutions that support business operations, analytics, AI initiatives, and project delivery.

Own end-to-end technical design, development, and delivery of enterprise data engineering solutions.

Design and implement scalable ETL/ELT, data integration, and data transformation pipelines for structured and unstructured data sources.

Develop and maintain batch, near real-time, and streaming data ingestion pipelines from databases, APIs, files, cloud storage, and enterprise applications.

Build reusable notebooks, data transformations, and processing frameworks using Databricks, Microsoft Fabric, Python, PySpark, and SQL.

Create trusted datasets, curated data products, and semantic-ready data structures supporting analytics, reporting, AI, and machine learning initiatives.

Primary Skill

Databricks

Microsoft Fabric

Python

SQL

Secondary Skill

OneLake

Spark

📌 Lead Software Engineer (Gurugram)
🏢 Virtusa
📍 Gurugram