02 Oct
|
Persistent Systems
|
Pune
02 Oct
Persistent Systems
Pune
About Position:
We are looking for an experienced Big Data Software Engineer to join a highly skilled technology team focused on innovation, learning, and prototyping next-generation data solutions. As part of the Ingestion Services team, you will contribute to building and standardizing enterprise data ingestion frameworks using modern Big Data technologies.
• Role: Senior Big Data Software Engineer - Spark, Scala & Databricks
• Location: All Persistent Locations
• Experience: 5 to 10 Years
• Job Type: Full time Employment
What You'll Do:
• Understand business requirements and align technical solutions with enterprise architecture and global solution design.
• Design, develop, and enhance Big Data ingestion solutions using Spark, Scala, Databricks, and PySpark.
• Configure and implement application and integration services to support business and platform requirements.
• Build scalable and reusable data processing frameworks for enterprise data ingestion and transformation.
• Develop proof of concepts, prototypes, and innovative solutions aligned with business strategies.
• Follow source-driven development, test-driven development, and engineering best practices.
• Design, build, and maintain CI/CD pipelines using GitHub and GitHub Actions.
• Develop and execute unit tests and integration tests to ensure solution quality and reliability.
• Troubleshoot production issues, perform root cause analysis, and implement effective resolutions.
• Collaborate with architects, developers, analysts, and business stakeholders across global Agile/Scrum teams.
• Support production environments and continuously improve platform performance, reliability, and scalability.
• Contribute to DevSecOps initiatives and secure software engineering practices.
• Participate in Agile ceremonies including sprint planning, daily stand-ups, code reviews, retrospectives, and release activities.
Expertise You'll Bring:
• 5-10 years of experience in Big Data Engineering and enterprise softwar
📌 Senior Big Data Software Engineer (Pune)
🏢 Persistent Systems
📍 Pune