Senior data engineerIDMC for Data Quality Team IDMC Data Quality Data Engineering consultant
1 Key Responsibilities
Develop IDMC CDI mappings and Taskflows against approved design documents including the DQ evaluation mapping and the DQ orchestration Taskflow nested parallelsequential Iterator pattern Depending on the validated approach implement rule evaluation either as parameterised source SQL with embedded rule expressions CDIonly or as CDQ assets rule specifications maplets and dictionarybased validations integrated into CDI mappings
Build and maintain SQL Server database objects control tables rule library error fact tables staging tables and write productionquality TSQL for SQL tasks within Taskflows audit logging energetic SQL assembly watermark logic dimension scoring
Populate and validate the DQ rule library translating quality rules into executable rule definitions across quality dimensions Completeness Validity Consistency Accuracy Uniqueness Timeliness in whichever form the validated approach requires TSQL CASE expressions or CDQ rule specifications
Execute unit testing QA integration testing and support production deployment across all three frameworks
Work in a paired development model with the IPS Lead Developer actively absorbing platform knowledge patterns and IDMC best practices
Participate in sprintend walkthroughs and formal knowledge transfer sessions contribute to implementation documentation
Demonstrate independent capability by engagement end able to add a new source connection register a new DQ rule and debug a failed run using the audit log without IPS support
2 Required Skills And Experiences
Must have
7 years handson data engineering ETL development experience in enterprise environments
Equal and demonstrated proficiency in both IDMC CDI and IDMC CDQ this is a dualcapability role
CDI mappings Taskflows parameter sets runtime parameter overrides dynamic field propagation genericreusable mapping patterns delivered in production
CDQ rule specifications maplets cleanseparseverifier assets dictionarybased validations and binding CDQ assets to CDI mappings delivered in production
Familiarity with the April 2026 Unified Data Quality capability DQ assets created directly within Data Integration is a strong advantage
Advanced SQL TSQL complex queries dynamic SQL stored procedure patterns performanceaware query design on SQL Server
Data Quality domain understanding quality dimensions rulebased validation error capture and scoring concepts
Experience working against formal design documentation with design authority governance
Comfortable in a paired mentored development model receptive to knowledge transfer and able to work alongside a senior external lead
Nice to have
Power BI development experience dataset design DAX measures Row Level Security useful for liaising with the Power BI track and understanding how DQ Framework output dimension scores error detail will ultimately be consumed downstream
Databricks or Azure Synapse as target platforms ABFS ADLS familiarity
Azure fundamentals AD groups Key Vault service principals
Experience in metadatadriven controltabledriven framework builds
Power BI data model awareness helpful for the dashboard track not required
Automotive or manufacturing industry background
3 Profile attributes
Selfsufficient developer who can take a designed component and deliver it with limited supervision
Detailoriented this programme has formal review gates source control discipline and design signoff requirements
Strong communicator in English daily collaboration with IPS Technical Lead and Data Architect
Genuinely motivated to learn the engagement is deliberately structured to build lasting IDMC capability and the consultant is one of the primary recipients of that investment
Role Senior Data Engineer IDMC Data Quality
We are looking for a Senior Data Engineer with strong handson experience in Informatica IDMC CDI CDQ SQL and modern AzureDatabricks data platforms The role involves developing a metadatadriven Data Quality framework building CDI mappings and Taskflows implementing CDQ rules and integrating data pipelines with Azure and Databricks
Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable