Experience: 5 to 6 years

Location: Chennai / Bangalore

Job purpose:

Lead end-to-end consulting engagements and technical delivery on Microsoft Fabric. Own solution discovery, architecture design, governance, and implementation across ingestion, transformation, modelling, analytics, and operations. Mentor teams, drive best practices (CDC, SCD, Direct Lake), ensure compliance and cost optimization, and communicate value to business stakeholders.

Duties and responsibilities of position:

General areas of responsibility relate to:

Lead client requirements workshops, convert business goals into technical user stories and Fabric solution architectures.

Design secure, scalable, cost-optimized data platforms leveraging Fabric OneLake, Lakehouse, Warehouse, Data Factory, Dataflows, Notebook-based Data Engineering, Semantic Models, and Power BI.

Define and enforce governance (catalogue, lineage, policies) and security (RBAC, data masking, sensitivity labels) aligned with GDPR/HIPAA/SOC 2.

Experience with database modeling for relational databases.Prepare HLD/LLD, architecture diagrams, data flow/sequence designs, and estimation/resourcing plans.

Establish delivery frameworks (branching model, CI/CD, environments, quality gates) and oversee production reliability (SLAs, incident response, RCA).

Mentor associate and consultant-level engineers; guide code reviews and architecture decisions.

Partner with enterprise teams to integrate Fabric solutions with Azure (Synapse, Databricks), Microsoft Purview, and source/target systems.

Specific areas of responsibility include but are not limited to:

Architect parameterized, metadata-driven pipelines using Fabric Data Factory (copy activities, data movement, orchestration) and Dataflows for low-code transformations.

Implement incremental loads, CDC (watermark/timestamps, change tables/logs), and idempotent retry/error handling patterns.

Land data in OneLake with medallion zones (bronze/silver/gold); standardize folder structures, naming, and metadata.

Build scalable Spark notebooks for ETL/ELT in Fabric Lakehouse; optimize with partitioning, Z-ordering, broadcast joins, shuffle management.

Implement SCD Type 1/Type 2 using Delta Lake MERGE (surrogate keys, effective/expiry dates, current record flags, audit columns).

Design Warehouse-based SQL transformations for curated marts; handle schema evolution and performance tuning

Design dimensional models (star/snowflake), conformed dimensions, and KPI-aligned fact tables.





Create Power BI semantic models integrated with Lakehouse/Warehouse; leverage Direct Lake for high-performance, near real-time analytics.

Establish DAX standards, aggregations, and performance optimization strategies (composite models, incremental refresh, query caching)

Configure workspaces, roles/permissions, sensitivity labels, and Row/Column-Level Security.

Integrate with Microsoft Purview (cataloguing, lineage, classifications, data policies) and maintain stewardship workflows.

Document and enforce data retention, access reviews, and audit trails.

Implement Git-based versioning; set up CI/CD for Fabric artifacts via Azure DevOps/GitHub Actions (build/validate/deploy with approvals).

Define environment promotion (dev test prod), variable/secret management, and rollback/DR strategies.

Create release notes, deployment runbooks, and quality gates (linting/tests/scan policies).

Monitor pipelines, notebooks, and datasets using Fabric observability; define SLAs/SLOs and freshness/latency KPIs.

Configure alerts for failures/anomalies; lead root cause analysis and remediation plans.

Optimize costs via right-sizing, on-demand vs. scheduled compute, storage lifecycle policies, and tagging for FinOps visibility.

Other duties:

Lead solution walkthroughs, trade-off analysis (Lakehouse vs. Warehouse, Direct Lake vs. Import, streaming vs. micro-batch).

Build POCs (Direct Lake performance, CDC/SCD2, governance integration) to de-risk decisions.

Manage risks/assumptions, change requests, and stakeholder communications; ensure business value realization.

Contribute to proposals, estimations, SOWs, and delivery plans for Fabric engagements.

Prepare executive dashboards/reports on platform performance, data quality, governance posture, and incidents.

Support integration with upstream/downstream platforms (APIs, event streams, line-of-business apps).

Drive internal best practices: coding standards, templates, accelerators, and knowledge sessions.

Provide after-hours support for critical releases or incidents on a rotational basis.

Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field; or equivalent professional experience.





Minimum of 5+ years of experience in data engineering with 4+ years focused on Microsoft Fabric

Power Apps, Power Automate, and Copilot (or similar AI-driven tools) experience for automation and solution development.

Implement Cloud Data Platform architectures, ensuring scalability, security, and cost efficiency.

Strong hands-on experience with Azure Data Factory (ADF), Synapse Analytics, and Data Lake Storage (ADLS Gen2), Key Vault.

Proficiency in SQL, Python for data processing and transformations.

Experience with Azure SQL, Cosmos DB, or other NoSQL databases.

Hands-on experience in data modeling, indexing, and query performance tuning.

Experience working with big data processing frameworks such as Databricks or Spark.

CI/CD experience (Azure DevOps, GitHub Actions) to automate deployment and integration.

PowerShell scripting for task automation.

Knowledge of virtual and physical infrastructure, network administration, and vulnerability management.

Virtual and Physical Infrastructure and Network administration.

Proficiency in vulnerability management across platforms (Windows, Linux, Network devices etc.)

Working knowledge of firewalls, network and server security, SSL certificates and security best practices.

Certifications (Preferred):

Microsoft Certified: Azure Solutions Architect Expert (AZ-305)

Microsoft Certified: Microsoft Fabric Analytics Engineer Associate (DP-600)

Microsoft Certified: Azure Administrator Associate (AZ-104)

In-depth knowledge of Microsoft Azure services, including Virtual Machines, Storage, Networking, Azure Databricks, and Azure Monitor.

Working knowledge of Microsoft Windows Server 2016/2019 deployment and management including Active Directory, Group Policies, and scripting (Powershell, Python)

Experience with Microsoft 365 administration (e.g., Exchange, SharePoint, OneDrive, Teams).

Experience with backup, disaster recovery, and business continuity planning.

Strong understanding of cloud security risks, including data breaches, malware, and social engineering.

Excellent collaboration skills for working with cross-functional teams and providing leadership in cloud security projects.

Experience working in a team, able to lead, prioritize and execute tasks in a high-pressure setting and provide or make sound decisions in emergencies.

Strong client-facing communication, facilitation, and executive presentation skills.

Experience leading small teams/workstreams, mentoring, and driving delivery governance.

Structured problem-solving with focus on scalability, reliability, and cost optimization.

📌 Senior Consultant (Fabric) (Chennai)
🏢 GainInsights
📍 Chennai