:

- 5+ years highly skilled Data Scientist, responsible for designing, developing, and maintaining large-scale data processing systems using cutting-edge technologies like Spark Streaming, Kafka, or similar technologies.
- The ideal candidate will have a strong background in object-oriented programming, data architecture, and cloud-based data management. The successful candidate will work closely with cross-functional teams to deliver complex data projects.

Your role:

- Implement Real-time Data Processing Solutions: Design, develop, and deploy real-time data processing solutions using Spark Streaming and/or Kafka to handle high-volume, high-velocity data streams.
- Stream Processing Frameworks: Ability to develop / work on / maintain a near real-time stream processing frameworks to handle high-volume, high-velocity data streams, leveraging Spark Streaming and/or Kafka.
- Advanced Data Storage: Knowledge of advanced data storage formats like Apache Hudi or Apache Iceberg to optimize data storage, management, and retrieval.
- Code Quality and Maintainability: Develop and maintain high-quality, maintainable code using object-oriented programming principles, ensuring scalability, efficiency, and reliability.
- ETL Process Design and Implementation: Experience with designing and implementing ETL (Extract, Transform, Load) processes managing data pipelines, data transformation, and data loading.




- Collaboration and Communication: Collaborate with cross-functional teams, including data engineering, data analytics, software developers, testers, cloud architects and business stakeholders to deliver complex data projects, ensuring alignment with business objectives and technical requirements.
- Data Architecture and Security: Participate in designing and implementing data architectures, ensuring data security, governance, and compliance with organizational standards.

What we need:

- masters or Ph.D. in Computer Science, Statistics, Mathematics, or related fields.
- 5+ years of experience in data science, data engineering, or related fields.
- Robust expertise in Spark Streaming and/or Kafka
- Hands on knowledge of Apache Hudi, Apache Iceberg, and AWS Glue.
- Very good proficiency in object-oriented programming languages (Java, Scala, Python).
- Experience with cloud-based data management (AWS, GCP, Azure).
- Strong understanding of data architecture, data modeling, and data governance.
- Excellent problem-solving skills, with the ability to work in a fast-paced environment.
- Strong communication and collaboration skills, with experience working in cross-functional teams.
- Experience with Agile development methodologies and version control systems (eg, Git).

📌 Data Scientist (Pune)
🏢 Sourceright Technologies (India) Private
📍 Pune