Job Description: Data Engineer – Data Pipelines & GovernanceLocation: Chennai (Preferred) / Pune / Hyderabad / BangaloreContract Duration: (6 Months)Shift: UK Shift (2:00 PM – 11:00 PM)OverviewWe are seeking a hands-on Data Engineer to develop, optimize, and maintain automated data pipelines supporting data governance and analytics initiatives. This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration, primarily using Azure Databricks, Azure Data Lake, and MS Purview.Experience: 5+ years in data engineering, with strong Azure and Databricks experienceKey ResponsibilitiesPipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks.Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation.Governance Metrics Automation – Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.MS Purview Integration – Automate asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.Data Retention & Policy Enforcement – Implement logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).Job & Query Monitoring – Build pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.Metadata Storage & Optimization – Maintain curated Delta tables for governance metrics,



structured for efficient dashboard consumption.Testing & Troubleshooting – Monitor pipeline execution, optimize performance, and resolve issues quickly.Collaboration – Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues.Security & Compliance – Ensure all pipelines meet organizational governance, privacy, and security standards.Required QualificationsBachelor’s degree in computer science, Engineering, Information Systems, or related field5+ years of hands-on data engineering experience, with Azure Databricks and Azure Data LakeProficiency in PySpark, SQL, and ETL/ELT pipeline designDemonstrated experience building granular data quality checks and integrating governance logic into pipelinesWorking knowledge of MS Purview for metadata management, lineage capture, and classificationExperience with Azure Data Factory or equivalent orchestration toolsUnderstanding of data modeling, metadata structures, and data cataloging conceptsStrong debugging, performance tuning, and problem-solving skillsAbility to document pipeline logic and collaborate with cross-functional teamsDexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.Dexian connects the right talent and the right technology with the right organizations to deliver trajectory-changing results that help everyone achieve their ambitions and goals. To learn more, please visit https://dexian.com/.Dexian is an Equal Chance Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

📌 Data Engineer (Jharkhand)
🏢 Dexian
📍 Jharkhand