Roles & Responsibilities — Data Engineer (SQL, DBT, Azure, ADF & Microsoft Fabric)

1. Data Engineering & Pipeline Development

Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Fabric Data Factory.

Implement batch, incremental, and CDC-based ingestion from diverse cloud and onprem data sources.

Maintain robust orchestration with scheduling, dependency management, retries, and monitoring.

2. SQL Development & Optimization

Develop complex SQL transformations, stored procedures, views, and analytical datasets.

Optimize SQL workloads using indexing, partitioning, statistics management, and execution plan tuning.

Implement data validation, reconciliation checks, and quality rules using SQL-driven logic.

3. DBT Transformation Engineering

Build modular, version-controlled data models using DBT (staging, intermediate, marts).

Implement DBT tests, documentation, macros, and incremental models for scalable ELT processing.

Maintain lineage, quality checks, and deployment workflows using DBT Cloud or DBT Core + CI/CD.

4. Azure & Microsoft Fabric Engineering

Develop and manage datasets and curated layers using Microsoft Fabric Lakehouse/Warehouse.

Implement Delta/Parquet-based data structures, schema evolution, and medallion architecture patterns.

Configure and optimize Fabric pipelines, Lakehouse tables, Warehouses, and SQL endpoints.

5. Performance, Quality & Monitoring

Monitor performance across SQL queries, DBT jobs, ADF pipelines, and Fabric workloads.





Implement automated data quality checks, SLA monitoring, and alerting using Azure Monitor/Log Analytics.

Troubleshoot bottlenecks and ensure pipeline reliability through optimization and proactive maintenance.

6. Security, Governance & CI/CD

Apply Azure and Fabric security standards: RBAC, secrets management, RLS/OLS, and workspace governance.

Maintain Git-based version control and deploy pipelines, DBT models, and Fabric assets via Azure DevOps/GitHub Actions.

Ensure adherence to governance standards for metadata, lineage, and KPI definitions.

7. Collaboration & Delivery

Work with BI, analytics, and product teams to translate business requirements into scalable data solutions.

Provide clean, well-modelled datasets for reporting, analytics, and downstream consumption.

Document pipelines, models, dependencies, and troubleshooting guidelines for ongoing support.

Optional: Role Scope Keywords (Valuable for Job Portals / ATS)

ADF, Microsoft Fabric, Fabric Data Factory, Lakehouse, Warehouse, Power BI semantic models, DAX, Power Query (M), DBT, SQL performance tuning, incremental loads, CI/CD, Azure DevOps, GitHub Actions, governance, RLS/OLS, monitoring.

Pay: ₹2,700,000.00 - ₹3,000,000.00 per year

Benefits:

- Cell phone reimbursement
- Flexible schedule
- Internet reimbursement
- Paid sick time
- Paid time off
- Provident Fund
- Work from home

Work Location: Hybrid remote in Bangalore City, Bengaluru, Karnataka

📌 Senior Data Engineer (Bengaluru)
🏢 Drivethrive
📍 Bengaluru