15 Sep
|
TechLeno
|
India
- Data Quality & Test Engineer
- Experience:7-10 years
- Budget:150 LPM
- Remote
- Contract:3 months
- Shift:IST
Data Validation & Quality Assurance
- Define, develop, and execute comprehensive test plans for:
o Data pipelines o ETL/ELT processes o Machine Learning workflows o Cloud infrastructure components
- Validate data accuracy, completeness, consistency, and integrity across:
o Raw Layer o Curated Layer o Summarized/Consumption Layer
- Verify schema consistency, data mappings, transformations, and business rules.
- Conduct end-to-end data reconciliation and source-to-target validation.
Test Automation
- Design, develop, and maintain automated test frameworks and scripts.
- Create and execute:
o Unit Tests o Integration Tests o Regression Tests o Data Quality Tests
- Develop automated test cases for:
o AWS Glue Jobs o AWS Lambda Functions o AWS Step Functions o API integrations
- Improve test coverage and reduce manual testing efforts through automation.
CI/CD & Release Validation
- Validate CI/CD deployments across development, QA, and non-production environments.
- Collaborate with DevOps teams to perform deployment verification and release testing.
- Ensure successful execution of automated test suites during deployment cycles.
- Support post-deployment validation and environment certification activities.
Observability & Monitoring Validation
- Verify effectiveness of platform observability mechanisms.
- Validate:
o Application logging o CloudWatch metrics o Monitoring dashboards o Alerting mechanisms
- Ensure production support readiness through proactive monitoring validation.
Security & Compliance Testing
- Conduct security validation in partnership with DevSecOps teams.
- Verify:
o Role-Based Access Control (RBAC)
o IAM policies and permissions o Data access controls o Security configurations
- Support compliance and governance testing requirements.
Documentation & Reporting
- Create and maintain:
o Test strategies o Test plans o Test cases o Test execution reports o Defect reports
- Track defects through their lifecycle and collaborate with development teams for resolution.
- Prepare testing metrics and quality dashboards for stakeholder review.
Continuous Improvement & Knowledge Management
- Support regression testing following reference implementation updates and platform enhancements.
- Identify opportunities for process improvements and automation.
- Contribute to quality engineering best practices and standards.
- Create test execution playbooks and knowledge transfer documentation.
- Participate in sprint planning, retrospectives, and quality reviews.
Required Skills & Qualifications
Technical Skills
- 5-6 years of experience in Data Testing, ETL Testing, Data Quality Engineering, or QA Automation.
- Solid understanding of Data Warehousing, Data Lakes, and modern Data Platforms.
- Hands-on experience with AWS services:
o AWS Glue o AWS Lambda o AWS Step Functions o Amazon S3
o CloudWatch o IAM
- Experience in SQL and complex data validation queries.
- Strong understanding of data transformation and reconciliation testing.
- Experience with automated testing frameworks and scripting languages such as Python.
- Knowledge of CI/CD tools such as Azure DevOps, GitHub Actions, Jenkins, or GitLab CI/CD.
- Experience testing REST APIs and event-driven architectures.
Quality Engineering Skills
- Unit Testing
- Integration Testing
- Regression Testing
- UAT Support
- Defect Management
- Test Automation
- Data Quality Assurance
Security & Monitoring
- Understanding of IAM, RBAC, and data security testing.
- Familiarity with monitoring and observability practices.
- Knowledge of DevSecOps principles is preferred.
Preferred Qualifications
- Experience with Data Lakehouse architectures.
- Exposure to Machine Learning workflow testing.
- Experience with Great Expectations, PyTest, or similar data validation frameworks.
- Knowledge of Infrastructure as Code (Terraform, CloudFormation).
- AWS Certification (Preferred):
o AWS Certified Cloud Practitioner o AWS Certified Developer Associate o AWS Certified Data Engineer Associate
Soft Skills
- Strong analytical and problem-solving abilities.
- Excellent communication and stakeholder management skills.
- Attention to detail and quality-focused mindset.
- Ability to work effectively in Agile/Scrum environments.
- Strong documentation and reporting skills.
📌 Data Quality & Test Engineer (Remote and contract) (India)
🏢 TechLeno
📍 India