Job Overview:

We are seeking a highly skilled and detail-oriented Data Engineer / Data Analyst with solid expertise in Python, Hadoop, PySpark, R Programming, Unix, Tableau, AWS, Machine Learning, and Data Testing. The ideal candidate will be responsible for developing, testing, validating, and optimizing large-scale data processing pipelines while ensuring data quality, reliability, and performance across cloud and on-premises environments.

The candidate should possess hands-on experience in big data technologies, cloud platforms, data visualization, and testing methodologies to support enterprise-level analytics and business intelligence initiatives.

Key Responsibilities
- Design, develop, test, and maintain scalable data pipelines using Python and PySpark.
- Perform data validation, functional testing, regression testing, and ETL testing for large-scale data applications.
- Develop and optimize data processing workflows using Hadoop ecosystem components.
- Write efficient Python and PySpark scripts for data ingestion, transformation, and processing.




- Utilize R Programming for statistical analysis, predictive modeling, and data exploration.
- Build interactive dashboards and reports using Tableau to support business decision-making.
- Work with AWS services such as S3, EMR, Glue, Lambda, EC2, Athena, and Redshift for cloud-based data solutions.
- Execute SQL queries and perform data reconciliation between multiple data sources.
- Analyze data quality issues and implement automated validation frameworks.
- Collaborate with developers, business analysts, data scientists, and QA teams to ensure data accuracy and completeness.
- Develop and execute test cases, test plans, and automation scripts for data validation.
- Monitor production jobs and troubleshoot failures in distributed data processing environments.
- Work in Unix/Linux environments to execute shell scripts, schedule jobs, and manage system operations.
- Participate in code reviews and implement best p

📌 Python Tester (Hyderabad)
🏢 Orcapod Consulting Services
📍 Hyderabad