31 Jul
|
N Labs
|
Telangana
Job Title: Data QA Engineer (Junior / Mid / Senior)- Hyderabad
Experience
- Junior: 13 Years
- Mid-Level: 35 Years
- Senior: 5–8 Years
Job Summary
We are looking for a Data QA Engineer to validate the reliability, accuracy, and performance of data pipelines and analytics platforms built on AWS, Databricks, Kafka, SQL, and Python. The role involves testing ETL/ELT workflows, ensuring data quality, automating validations, and collaborating with Data Engineering teams to deliver high-quality data solutions.
Key Responsibilities
- Validate ETL/ELT and batch/streaming data pipelines.
- Perform data validation using SQL and Python.
- Test Databricks, Spark, and Kafka-based data workflows.
- Validate AWS data services (S3, Glue, Lambda, Redshift, Athena).
- Build automated data testing frameworks.
- Perform data reconciliation,
schema validation, and data quality checks.
- Execute performance, regression, and end-to-end testing.
- Integrate automated tests into CI/CD pipelines.
Key Skills
- SQL (Advanced)
- Python
- ETL/ELT Testing
- Data Quality Testing
- Databricks
- Apache Spark (PySpark)
- Apache Kafka
- AWS (S3, Glue, Lambda, Redshift, Athena)
- Data Validation & Reconciliation
- API Testing
- CI/CD (Jenkins, GitHub Actions)
- Git
- CloudWatch / Grafana / Prometheus (Preferred)
Nice to Have
- Delta Lake
- Excellent Expectations / Soda / Deequ
- Airflow
- Snowflake
- Agile/Scrum experience
📌 Data Quality Engineer (Telangana)
🏢 N Labs
📍 Telangana