01 Aug
|
N Labs
|
Telangana
Job Title: Data QA Engineer (Junior / Mid / Senior)- Hyderabad
Experience
Junior: 13 Years
Mid-Level: 35 Years
Senior: 5–8 Years
Job Summary
We are looking for a Data QA Engineer to validate the reliability, accuracy, and performance of data pipelines and analytics platforms built on AWS, Databricks, Kafka, SQL, and Python. The role involves testing ETL/ELT workflows, ensuring data quality, automating validations, and collaborating with Data Engineering teams to deliver high-quality data solutions.
Key Responsibilities
Validate ETL/ELT and batch/streaming data pipelines.
Perform data validation using SQL and Python.
Test Databricks, Spark, and Kafka-based data workflows.
Validate AWS data services (S3, Glue, Lambda, Redshift, Athena).
Build automated data testing frameworks.
Perform data reconciliation, schema validation, and data quality checks.
Execute performance, regression, and end-to-end testing.
Integrate automated tests into CI/CD pipelines.
Key Skills
SQL (Advanced)
Python
ETL/ELT Testing
Data Quality Testing
Databricks
Apache Spark (PySpark)
Apache Kafka
AWS (S3, Glue, Lambda, Redshift, Athena)
Data Validation & Reconciliation
API Testing
CI/CD (Jenkins, GitHub Actions)
Git
CloudWatch / Grafana / Prometheus (Preferred)
Nice to Have
Delta Lake
Excellent Expectations / Soda / Deequ
Airflow
Snowflake
Agile/Scrum experience
📌 Data Quality Engineer Telangana
🏢 N Labs
📍 Telangana