We are seeking a skilled Big Data Tester with strong expertise in Python, Hadoop ecosystems, and ETL processes. The ideal candidate will be responsible for validating large-scale data pipelines, ensuring data accuracy, performance, and reliability across distributed systems.
Key Responsibilities
- Design and execute test strategies for big data applications and ETL workflows.
- Validate data ingestion, transformation, and storage processes in Hadoop clusters.
- Develop automated test scripts using Python for data validation and regression testing.
- Perform data quality checks, schema validation, and reconciliation across multiple sources.
- Collaborate with developers, data engineers, and business analysts to ensure end-to-end data integrity.
- Conduct performance testing for large datasets and optimize test execution.
- Document test cases, results, and defects; ensure compliance with QA standards.
Required Skills
- Robust hands-on experience in Python scripting for automation and data validation.
- Proficiency in Hadoop ecosystem tools (HDFS, Hive, Spark, Pig, MapReduce).
- Solid understanding of ETL concepts and experience with tools like Informatica, Talend, or custom ETL pipelines.
- Experience with SQL for querying and validating large datasets.
- Familiarity with data warehousing concepts and big data testing methodologies.
- Knowledge of test automation frameworks and CI/CD integration.
📌 Big Data Tester (Bengaluru)
🏢 StatusNeo Technology Consulting
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.