As a Lead Specialist for Big Data Platforms, you will serve as the technical anchor for our clients data infrastructure, overseeing the architecture, deployment, and optimization of large-scale distributed systems.
You will work closely with data engineers, architects, and business stakeholders to translate complex data requirements into robust, scalable platform solutions.
Your efforts will directly influence the efficiency of data pipelines and the reliability of analytical insights, ensuring that the organization can leverage its data assets to drive critical business outcomes.
Key Responsibilities :
- Architect and maintain high-performance Big Data platforms to support enterprise-wide data processing and analytics requirements.
- Design and implement scalable data pipelines using Hadoop and Scala to ensure seamless data ingestion, transformation, and storage.
- Optimize existing cluster configurations and query performance to reduce latency and improve resource utilization for business-critical applications.
- Collaborate with cross-functional engineering teams to integrate new data technologies and frameworks into the existing ecosystem.
- Establish best practices for data governance, security,
and platform reliability to maintain high standards of data integrity.
- Mentor junior engineers and provide technical guidance on complex troubleshooting and system design challenges.
Required Skillset :
- Demonstrated expertise in designing and managing complex Hadoop ecosystems within large-scale production environments.
- Proficiency in developing high-performance data processing applications using Scala.
- Strong ability to communicate complex technical concepts to non-technical stakeholders and influence project direction.
- Proven track record of managing end-to-end platform lifecycles, from initial architecture design to ongoing maintenance and optimization.
- Capability to thrive in a cooperative, fast-paced environment, with a focus on delivering high-quality technical solutions.
- Minimum of 6 to 15 years of professional experience in Big Data engineering or platform architecture roles.
- Ability to work effectively in a hybrid or on-site capacity at our Gurgaon/Gurugram office location.