We are seeking a highly skilled Senior Data Engineer to contribute to the data management and engineering initiatives supporting Test & Learn and other analytics-driven products. The ideal candidate will have extensive experience in building scalable data pipelines, optimizing data processing frameworks, and delivering high-quality data solutions in cloud environments. You will work closely with data engineers, analysts, and business stakeholders to design and implement enterprise-grade data platforms that enable advanced analytics and business experimentation capabilities.
- Role: Senior Data Engineer - PySpark & Databricks
- Location: All Persistent Locations
- Experience: 8 to 12 Years
- Job Type: Full Time Employment
What You'll Do:
- Design, develop, and maintain scalable enterprise data pipelines and ETL/ELT solutions.
- Support the implementation and maintenance of cloud-based data platforms for a global client base.
- Build robust and highly available data engineering solutions using PySpark, Python, SQL, and Databricks.
- Develop effective data processing frameworks capable of handling large-scale datasets.
- Optimize SQL queries and data workloads to improve performance and scalability.
- Partner with analytics teams and business stakeholders to understand business requirements and translate them into technical data solutions.
- Design and implement data transformation, cleansing, and validation processes to ensure data quality and accuracy.
- Collaborate with Data Engineers, Analysts, and Architects to deliver accurate, reliable, and business-ready datasets.
- Participate in code reviews and ensure adherence to software engineering and data engineering best practices.
- Implement automated data validation, monitoring, and quality control mechanisms.
- Support data platform modernization and continuous improvement initiatives.
- Contribute to DevOps and CI/CD processes for data engineering workflows.
- Build strong relationships with inte
📌 Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.