Work Locations: Chennai / Bangalore / Hyderabad / Pune / Kolkata
Primary Skills: PySpark, AWS
Role Overview
We are looking for an experienced PySpark Developer with strong hands-on expertise in PySpark and AWS. The ideal candidate will have a strong foundation in data engineering and distributed data processing, with the ability to develop scalable, reliable, and performance-oriented data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data-processing solutions using PySpark.
- Develop efficient data transformation and processing workflows for large datasets.
- Build and support data engineering solutions within an AWS cloud environment.
- Optimize PySpark applications for performance, scalability, and reliability.
- Troubleshoot data-processing and application performance issues.
- Participate in requirement analysis, solution design, development, testing, and deployment activities.
- Collaborate with cross-functional teams to understand business requirements and translate them into effective technical solutions.
- Follow development standards and data engineering best practices.
Required Skills
- Strong hands-on experience with PySpark.
- Good hands-on experience working with AWS.
- Strong understanding of Apache Spark and distributed data-processing concepts.
- Experience in developing and optimizing large-scale data-processing solutions.
- Good analytical, troubleshooting, and problem-solving skills.
- Ability to work effectively in a cooperative development environment.
Preferred Skills Experience with Python, SQL, ETL/data pipelines, big-data technologies, or AWS data services would be advantageous, but these should be treated as preferred rather than mandatory unless confirmed by the hiring team.
Candidate Profile The ideal candidate should have 5–10 years of overall IT experience with strong practical exposure to PySpark and AWS, along with experience delivering scalable data-engineering solutions in enterprise environments.