Job Description: PySpark Developer
Experience: 5–10 Years
Work Locations: Chennai / Bangalore / Hyderabad / Pune / Kolkata
Primary Skills: PySpark, AWS
Role Overview
We are looking for an experienced PySpark Developer with solid hands-on expertise in PySpark and AWS. The ideal candidate will have a solid foundation in data engineering and distributed data processing, with the ability to develop scalable, reliable, and performance-oriented data solutions.
Key Responsibilities
• Design, develop, and maintain scalable data-processing solutions using PySpark.
• Develop efficient data transformation and processing workflows for large datasets.
• Build and support data engineering solutions within an AWS cloud environment.
• Optimize PySpark applications for performance, scalability, and reliability.
• Troubleshoot data-processing and application performance issues.
• Participate in requirement analysis, solution design, development, testing, and deployment activities.
• Collaborate with cross-functional teams to understand business requirements and translate them into effective technical solutions.
• Follow development standards and data engineering best practices.
Required Skills
• Strong hands-on experience with PySpark.
• Good hands-on experience working with AWS.
• Strong understanding of Apache Spark and distributed data-processing concepts.
• Experience in developing and optimizing large-scale data-processing solutions.
• Good analytical, troubleshooting, and problem-solving skills.
• Ability to work effectively in a collaborative development environment.
Preferred Skills
Experience with Python, SQL, ETL/data pipelines, big-data technologies, or AWS data services would be advantageous, but these should be treated as preferred rather than mandatory unless confirmed by the hiring team.
Candidate Profile
The ideal candidate should have 5–10 years of overall IT experience with solid practical exposure to PySpark and AWS, along with experience delivering scalable d