20 Nov
|
Persistent
|
Pune
Job Description
About Persistent
We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what?s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 18 of the Fortune 50 companies, 7 of the 10 top US banks, 9 of the 10 technology companies, and numerous innovators across the healthcare ecosystem.
Our disruptor?s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We have delivered 26 sequential quarters of growth with $487.6M in Q2 FY27 revenue, up 7.8% Q-o-Q and 20.0% Y-o-Y. Our 29,500+ global team members, located in 21 countries, have been instrumental in helping the market leaders transform their industries. We received five awards at the ISG (Information Services Group) Provider Lens? Awards 2026 and, for the second year in a row, were awarded the Growth Honor of the Year at the Everest Group Elevate 2026.
About Position:
We are seeking a highly skilled Senior Data Engineer with 8 to 12 years of experience in designing, supporting, and optimizing enterprise-scale data platforms. The ideal candidate will possess strong hands-on expertise in Databricks and PySpark, along with extensive experience in troubleshooting production issues, resolving data quality challenges, and enhancing the reliability and performance of large-scale distributed data processing systems. This role requires close collaboration with cross-functional teams to build robust, scalable, and high-performing data solutions that support critical business operations.
- Role: Senior Azure Data Engineer
- Location: All Persistent Locations
- Experience: 6 to 10 Years
- Job Type: Full-Time Employment
What You'll Do:
- Design, develop,
and maintain scalable and high-performance data pipelines using Databricks and PySpark.
- Build and optimize ETL/ELT workflows to process large volumes of structured and unstructured data.
- Investigate, troubleshoot, and resolve production incidents, data discrepancies, and pipeline failures.
- Perform root cause analysis and implement preventive measures to improve platform stability.
- Monitor, tune, and optimize Spark jobs for performance, scalability, and resource efficiency.
- Collaborate with business stakeholders, architects, and engineering teams to gather requirements and implement data solutions.
- Support production deployments and provide L2/L3 support for critical enterprise data platforms.
- Develop monitoring, alerting, and operational processes to ensure data platform reliability.
- Establish and promote best practices for data engineering, coding standards, performance optimization, and operational excellence.
- Drive continuous improvements in data frameworks, automation, and platform modernization initiatives.
- Mentor junior engineers and contribute to technical knowledge sharing across teams.
Expertise You'll Bring:
- 8-12 years of experience in Data Engineering, Big Data, and distributed data processing environments.
- Solid hands-on expertise in Databricks for large-scale data engineering and analytics solutions.
- Extensive experience with PySpark development, optimization, and troubleshooting.
- Strong knowledge of SQL and data modeling concepts.
- Proven experience handling production support, incident management, and framework-related issues.
- Expertise in designing and supporting complex ETL/ELT pipelines.
- Strong debugging, troubleshooting, and performance tuning capabilities.
- Experience working with cloud platforms such as Azure or AWS.
- Knowledge of Delta Lake, Lakehouse architecture, and modern data platform design.
- Familiarity with CI/CD pipelines, DevOps practices, and monitoring tools.
- Understanding of data governance, data quality, and operational best practices.
- Excellent analytical, problem-solving, and communication skills.
- Ability to work effectively in a fast-paced environment and manage multiple priorities.
- Strong collaboration and stakeholder management capabilities.
- Experience mentoring and guiding junior team members.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
1
Open Positions
Databricks,Azure,PySpark
Skills Required
PUNE
Location
Databricks,Azure,PySpark
Desirable Skills
187539
Job Code
📌 Senior Azure Data Engineer (Pune)
🏢 Persistent
📍 Pune