Data Engineer (Bengaluru)

Data Engineer (Bengaluru)

13 Aug
|
DysrupIT
|
Bengaluru

13 Aug

DysrupIT

Bengaluru

JOB SUMMARY

This role is hands-on. You will be the day-to-day engineering pair of hands keeping a customer's CID environment healthy from the data landing in the lake, through the pipelines that move and shape it, into CID itself, and out to the unified profiles and segments the business consumes.

JOB RESPONSIBILITIES

D365 CID administration & support
- Administer Dynamics 365 Customer Insights Data: data sources, unification (match, merge, consolidate), enrichments, segments, measures, and exports.
- Support and extend an existing CID setup onboard recent sources, tune unification rules, manage refresh schedules and environment configuration.
- Triage and resolve CID issues raised by the customer’s business and IT teams: failed refreshes, broken segments, profile-count discrepancies, export failures, permission issues.
- Manage Support tickets with Microsoft relating to CID issues.

Data pipeline support & rectification
- Operate and support upstream data pipelines feeding CID, including custom .NET console applications that orchestrate ingestion and transformation steps.




- Support data flowing from multiple source systems through Azure Data Lake (ADLS Gen2) into CID folder and Delta layouts, CDM (Common Data Model) folders, partitioning, file freshness.
- Validate data on date (is today’s data actually there, on time, complete?) and data fitness for CID (schema, keys, types, nulls, duplicates) — and fix or escalate when it isn’t.
- Monitoring, observability & root-cause
- Build and maintain monitoring on pipeline runs, refresh status, row counts, and SLAs. Alert before the business notices.
- Perform root-cause analysis end-to-end — source → lake → pipeline → CID → consumer — and produce clean write-ups and permanent fixes, not just patches.

Microsoft Fabric (developing capability)
- Work alongside the architecture team on the customer’s Fabric roadmap Lakehouse / OneLake patterns, Dataflows Gen2, notebooks, and the path to consolidating ADLS-based pipelines into

📌 Data Engineer (Bengaluru)
🏢 DysrupIT
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: data engineer (bengaluru) / bengaluru