08 Sep
|
EduRun Group
|
Bengaluru
08 Sep
EduRun Group
Bengaluru
Role: Senior PySpark Developer
Experience: 5–10 Years
Employment Type: Full-Time
Notice Period: Immediate- 30 Days
We are looking for highly skilled Senior PySpark Developers with strong expertise in Core Python, PySpark, SQL, UNIX scripting, and ELT/ETL data processing. The ideal candidate should have hands-on experience building scalable data pipelines, processing large datasets, and developing batch and streaming solutions.
Mandatory Skills
- Strong Core Python programming skills with expertise in coding, data processing, and performance optimization
- Robust hands-on experience in PySpark development
- Experience in PySpark application design, job execution, performance tuning, and troubleshooting
- Hands-on experience in SQL coding
- Experience in ELT/ETL pipeline development and data integration frameworks
- Proficiency in UNIX/Linux Shell Scripting
- Experience in creating, modifying, and troubleshooting Shell scripts
- Experience with batch and real-time/streaming data processing
- Ability to handle large-scale data processing
- Experience in optimizing data workflows for performance and scalability
- Good understanding of Distributed Computing and Big Data Architecture
- Experience in requirement gathering, solution design, technical documentation, and implementation
- Strong analytical and problem-solving skills
- Excellent verbal and written communication skills
📌 Sr Pyspark Developer (Bengaluru)
🏢 EduRun Group
📍 Bengaluru