We are looking for a skilled Senior Pyspark Developer with 5 to 10 years of experience. The job location is versatile.
Role and Responsibilities
Design, develop, and deploy scalable data processing pipelines using Pyspark.
Collaborate with cross-functional teams to identify and prioritize project requirements.
Develop and maintain large-scale data warehouses and data lakes using Hadoop technologies.
Optimize data processing workflows for performance, scalability, and reliability.
Troubleshoot and resolve complex technical issues in the development environment.
Participate in code reviews and contribute to improving overall code quality.
Job Requirements
Solid proficiency in Python programming language and its ecosystem.
Experience with big data processing frameworks such as Hadoop and Spark.
Knowledge of database management systems such as MySQL or NoSQL databases like MongoDB.
Familiarity with cloud-based platforms such as AWS or Azure.
Excellent problem-solving skills and attention to detail.
Ability to work collaboratively in a team workplace and communicate effectively with stakeholders.
📌 Senior Pyspark Developer Chennai (India)
🏢 Luxoft
📍 India