03 Oct
|
Persistent Systems
|
Pune
03 Oct
Persistent Systems
Pune
About Position:
We are seeking a highly skilled Senior Data Engineer to contribute to the data management and engineering initiatives supporting Test & Learn and other analytics-driven products. The ideal candidate will have extensive experience in building scalable data pipelines, optimizing data processing frameworks, and delivering high-quality data solutions in cloud environments. You will work closely with data engineers, analysts, and business stakeholders to design and implement enterprise-grade data platforms that enable advanced analytics and business experimentation capabilities.
• Role: Senior Data Engineer - PySpark & Databricks
• Location: All Persistent Locations
• Experience: 8 to 12 Years
• Job Type: Full Time Employment
What You'll Do:
• Design, develop, and maintain scalable enterprise data pipelines and ETL/ELT solutions.
• Support the implementation and maintenance of cloud-based data platforms for a global client base.
• Build robust and highly available data engineering solutions using PySpark, Python, SQL, and Databricks.
• Develop efficient data processing frameworks capable of handling large-scale datasets.
• Optimize SQL queries and data workloads to improve performance and scalability.
• Partner with analytics teams and business stakeholders to understand business requirements and translate them into technical data solutions.
• Design and implement data transformation, cleansing, and validation processes to ensure data quality and accuracy.
• Collaborate with Data Engineers, Analysts, and Architects to deliver accurate, reliable, and business-ready datasets.
• Participate in code reviews and ensure adherence to software engineering and data engineering best practices.
• Implement automated data validation, monitoring, and quality control mechanisms.
• Support data platform modernization and continuous improvement initiatives.
• Contribute to DevOps and CI/CD processes for data engineering workflows.
• Build solid relationships with in
📌 Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune