Job Description – Data Quality Engineer (Databricks) – x 4 Positions
Location: Abudhabi - UAE - Onsite
Open to Relocate
Duration: 6 months ( Extendable to One Year)
Experience: 5 to 7 Years
Project start date is 1st July - Immediate joiners will be preferred

Role Overview
The Data Quality Engineer will be responsible for designing, implementing, and operating ADC's enterprise data quality framework within the Databricks platform. The role will deliver automated profiling, quality rule execution, cleansing, monitoring, remediation support, and quality reporting capabilities across 170 datasets and 1,346 prioritised Critical Data Elements (CDEs).
Working closely with Data Modellers, Data Catalogue Specialists, business data owners, and platform engineers, the Data Quality Engineer will establish scalable and reusable quality controls that improve trust, accuracy, completeness, consistency, timeliness, validity, and uniqueness across ADC's data estate.
Key Responsibilities
Databricks Platform Configuration and Administration




Configure and manage the Databricks setting supporting enterprise data quality operations.
Establish and maintain:
Compute clusters.
PySpark notebook frameworks.
Delta Lake storage structures.
Unity Catalog integration.
Optimise platform performance for large-scale profiling and rule execution across all in-scope datasets and CDEs.
Implement development, testing, and production deployment standards for data quality assets.

Data Profiling and Quality Assessment
Design and develop AI-assisted profiling notebooks using PySpark.
Perform baseline data quality assessments across the six quality dimensions:
Completeness.
Accuracy.
Consistency.
Validity.
Timeliness.
Uniqueness.
Capture and analyse:
Null value rates.
Duplicate records.
Invalid values.
Format violations.
Outliers.
Schema drift.
Produce quality profiling outputs for all prioritised CDEs and datasets.

Data Quality Rule Factory Development

📌 Data Quality Engineer Bengaluru
🏢 Datamatics Technologies
📍 Bengaluru