12 Nov
|
Persistent Systems
|
Pune
12 Nov
Persistent Systems
Pune
About Position: We are seeking a skilled Senior Data Engineer II with 6 to 12 years of experience in Data Engineering, ETL development, and large-scale data processing. The ideal candidate will possess strong expertise in Spark, Databricks, SQL, and data platform development. This role will contribute to the design, development, and maintenance of enterprise data pipelines supporting Test & Learn and other analytics-driven products. You will work closely with data engineers, analysts, and business stakeholders to deliver scalable, reliable, and high-quality data solutions that enable business experimentation and advanced analytics.
• Role: Senior Data Engineer
•
Location:
Pune
•
Experience:
6 to 12 years
•
Job Type
Full Time Employment
What You'll Do
• Design, develop, and maintain scalable ETL and data integration pipelines supporting enterprise analytics platforms.
• Support the implementation and maintenance of data platforms serving a global client base across multiple industry domains.
• Collaborate with Data Engineers, Data Analysts, and business stakeholders to deliver accurate, reliable, and high-value data solutions.
• Build and optimize data processing workflows using Spark and Databricks technologies.
• Develop reusable and scalable code capable of efficiently processing large data volumes.
• Design, implement, and maintain ETL pipelines supporting data ingestion, transformation, validation, and delivery.
• Write and optimize complex SQL queries to support reporting, analytics, and business intelligence requirements.
• Partner with analytics teams to translate business questions into technical data requirements and solutions.
• Perform data validation, quality checks, and reconciliation activities to ensure data accuracy and consistency.
• Contribute to metadata management, data lineage tracking, and data governance initiatives.
• Implement automation solutions to streamline repetitive data processing and operational tasks.
• Participate in code reviews, design reviews, and engineering best practice initiatives.
• Work collaboratively across multiple projects and client engagements while managing competing priorities.
• Create and maintain technical documentation, operational procedures, and support artifacts.
• Ensure compliance with organizational policies, security standards, and regulatory requirements. Expertise You'll Bring:
• 6 to 12 years of experience in Data Engineering, ETL Development, Data Integration, or Analytics Engineering.
• Strong hands-on expertise in Apache Spark and Databricks for large-scale data processing.
• Experience designing, developing, and maintaining enterprise-grade ETL pipelines.
• Strong understanding of data engineering concepts, data modeling principles, and database design methodologies.
• Proficiency in SQL with experience writing, optimizing, and troubleshooting complex queries.
• Hands-on experience with Microsoft SQL Server and relational database technologies.
• Strong understanding of data warehousing concepts, dimensional modeling, and analytical data structures.
• Experience handling large-scale datasets and optimizing data processing performance.
• Knowledge of data validation techniques and data quality assurance methodologies.
• Experience working with structured and semi-structured data sources.
• Ability to troubleshoot data issues and identify root causes with minimal supervision.
• Familiarity with data governance, metadata management, and lineage concepts.
• Experience using version control systems such as Git and collaborative development workflows.
• Strong analytical, problem-solving, and troubleshooting capabilities.
• Excellent verbal and written communication skills.
• Ability to effectively communicate complex technical concepts to technical and non-technical stakeholders.
• Experience working in Agile and Scrum-based development environments.
• Ability to work across multiple projects and competing priorities simultaneously.
Benefits:
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Values-Driven, People-Centric & Inclusive Work Environment: Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
• We support hybrid work and flexible schedule to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment Let's unleash your full potential at Persistent
- persistent.com/careers "Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
📌 Senior Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune