About Position:

We are seeking a highly skilled Senior Data Engineer with strong expertise in Python, PySpark, Advanced SQL, and AWS to design, build, and maintain enterprise-scale data platforms and processing solutions. The ideal candidate will have hands-on experience developing both batch and streaming data pipelines, optimizing large-scale data workloads, and leveraging AWS cloud services to deliver reliable, scalable, and high-performance data solutions. You will play a critical role in enabling data-driven decision-making by building robust data engineering frameworks and contemporary data platforms.

• Role: Senior Data Engineer Python, PySpark & AWS
• Location: Pune, Bengaluru
• Experience: Between 6 to 12 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable batch and real-time data pipelines using Python, PySpark, and Apache Spark.
• Build and optimize data ingestion, transformation, and processing frameworks for large-scale enterprise data environments.




• Develop and support streaming solutions using Spark Streaming and Spark Structured Streaming.
• Create efficient ETL/ELT pipelines to move, process, and transform data across multiple systems and platforms.
• Implement data quality controls, validation frameworks, and monitoring mechanisms to ensure data accuracy and reliability.
• Design and optimize advanced SQL queries, stored procedures, and data transformation logic.
• Leverage AWS services such as EMR, S3, Lambda, EC2, and Athena to build cloud-native data solutions.
• Collaborate with business stakeholders, data scientists, analysts, and application teams to understand and deliver data requirements.
• Troubleshoot and resolve performance bottlenecks in data pipelines and Spark workloads.
• Improve data platform scalability, performance, reliability, and operational efficiency.
• Participate in architecture discussions and contribute to data platform modernization initiatives.
• Follow engineering best practi

📌 Senior Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune