Experience: 6-10 years

Location: Hyderabad

Work Mode: Hybrid

Salary: Competitive

Employment Type: Full time

Role Overview

The Data Quality Engineer ensures the reliability, accuracy, performance, and scalability of data platforms and pipelines across batch and streaming workloads. The role focuses on validating end-to-end data ingestion, processing, enrichment, aggregation, and analytics on AWS, Kafka, Databricks, and Spark using SQL and Python. You will design and automate comprehensive test strategies, build reusable testing frameworks, and embed data quality checks throughout the lifecycle. The position partners closely with Data Engineering, Platform, Analytics, and DevOps teams to enforce SLAs/SLOs, secure data access, and maintain production readiness through CI/CD, monitoring, and incident response.

Required Qualifications
- 7+ years in QA, SDET, or Data Quality Engineering roles
- Expert SQL for complex data validation and reconciliation
- Proficiency in Python for automation and data testing frameworks
- Hands-on testing of ETL/ELT pipelines and data workflows




- Experience with streaming platforms (Apache Kafka or equivalent)
- Strong knowledge of AWS data services (S3, Glue, Redshift, Lambda, Athena, EMR, Step Functions)
- Databricks and Delta Lake testing experience
- Apache Spark (PySpark/Scala) validation experience
- Design and implementation of data quality checks (nulls, duplicates, schema drift, referential integrity)
- Experience with serialization formats (Avro, JSON, Protobuf) and schema evolution
- CI/CD integration for automated data tests and alerting
- Security and governance validation (IAM, permissions, encryption, lifecycle policies)
- Performance, load, and resilience testing for large-scale datasets
- Monitoring and observability using CloudWatch, Prometheus, Grafana (or similar)
- Strong debugging, analytical, and problem-solving skills

Responsibilities
- Validate batch and streaming data pipelines for correctness, completeness,

📌 Data Quality Engineer (Hyderabad)
🏢 Mobilution It Systems
📍 Hyderabad