We are looking for highly skilled Senior PySpark Developers with strong expertise in Core Python, PySpark, SQL, UNIX scripting, and ELT/ETL data processing. The ideal candidate should have hands-on experience building scalable data pipelines, processing large datasets, and developing batch and streaming solutions.
Mandatory Skills:
• Solid Core Python programming skills with expertise in coding, data processing, and performance optimization
• Strong hands-on experience in PySpark development
• Experience in PySpark application design, job execution, performance tuning, and troubleshooting
• Hands-on experience in SQL coding
• Experience in ELT/ETL pipeline development and data integration frameworks
• Proficiency in UNIX/Linux Shell Scripting




• Experience in creating, modifying, and troubleshooting Shell scripts
• Experience with batch and real-time/streaming data processing
• Ability to handle large-scale data processing
• Experience in optimizing data workflows for performance and scalability
• Good understanding of Distributed Computing and Big Data Architecture
• Experience in requirement gathering, solution design, technical documentation, and implementation
• Strong analytical and problem-solving skills
• Excellent verbal and written communication skills

📌 Senior Pyspark Developer (Bengaluru)
🏢 EduRun Group
📍 Bengaluru