13 Aug
|
Sourceright Technologies (India) Private
|
Pune
13 Aug
Sourceright Technologies (India) Private
Pune
Job description :
- 5+ years highly skilled Data Scientist, responsible for designing, developing, and maintaining large-scale data processing systems using cutting-edge technologies like Spark Streaming, Kafka, or similar technologies.
- The ideal candidate will have a solid background in object-oriented programming, data architecture, and cloud-based data management. The successful candidate will work closely with cross-functional teams to deliver complex data projects.
Your role:
- Implement Real-time Data Processing Solutions: Design, develop, and deploy real-time data processing solutions using Spark Streaming and/or Kafka to handle high-volume, high-velocity data streams.
- Stream Processing Frameworks: Ability to develop / work on / maintain a near real-time stream processing frameworks to handle high-volume, high-velocity data streams, leveraging Spark Streaming and/or Kafka.
- Advanced Data Storage: Knowledge of advanced data storage formats like Apache Hudi or Apache Iceberg to optimize data storage, management, and retrieval.
- Code Quality and Maintainability:
Develop and maintain high-quality, maintainable code using object-oriented programming principles, ensuring scalability, efficiency, and reliability.
- ETL Process Design and Implementation: Experience with designing and implementing ETL (Extract, Transform, Load) processes managing data pipelines, data transformation, and data loading.
- Collaboration and Communication: Collaborate with cross-functional teams, including data engineering, data analytics, software developers, testers, cloud architects and business stakeholders to deliver complex data projects, ensuring alignment with business objectives and technical requirements.
- Data Architecture and Security: Participate in designing and implementing data architectures, ensuring data security, governance, and compliance with organizational standards.
What we need:
- masters or Ph.D. in Computer Science, Statistics, Mathematics, or related fi
📌 Data Scientist (Pune)
🏢 Sourceright Technologies (India) Private
📍 Pune