Job Summary

Job Location: Pune

Employment Type: Full-Time

Experience: 5-10 Year

Role Overview

We are looking for a Senior Data Engineer to join our team and contribute to building high-performance, scalable data solutions that power seamless experiences for real estate professionals and customers. The ideal candidate has a strong background in Big Data, Java, and Cloud Technologies and thrives in fast-paced, agile environments. If you are passionate about designing effective data pipelines and working with cutting-edge technologies like Apache Spark , Kafka , and AWS , we want to hear from you!

Responsibilities

- Design, develop, and optimize scalable data pipelines and processing frameworks for high-volume datasets.
- Build and maintain real-time stream processing solutions using Apache Flink or Apache Spark with messaging platforms like Kafka .
- Develop ETL workflows and handle both structured and unstructured data processing at scale.
- Implement and manage NoSQL databases (e.g., MongoDB , DynamoDB ) and SQL-based solutions (e.g., PostgreSQL , Athena ).
- Work with AWS cloud services (Lambda, SNS, S3, Batch Jobs, Step Functions, EC2, ECR) to build robust data architectures.




- Collaborate with cross-functional teams to understand business requirements and design innovative data solutions.
- Follow Agile methodologies and contribute to sprint planning, code reviews, and deployment processes.

Skills & Experience Required
- Experience in Apache Spark Scala building high-volume, low-latency data pipelines.(Min 5years)
- Experience in real-time stream processing ( Apache Flink / Spark ) with Kafka / Pulsar . (Min 5 years)
- Experience in data pipeline development, ETL , and big data processing. ( Min 7 years)
- Experience in NoSQL databases (MongoDB, DynamoDB) and SQL-based systems (PostgreSQL, Athena). (Min 2 years)
- Hands-on experience with AWS services (Lambda, SNS, S3, Step Functions, EC2, etc.).(Min 2 years)
- Experience in Java development. (5+ years)
- Proficiency in Git/GitLab and working within an Agile framework .
- Strong problem-solving skills, excellent communication, and a proactive approach to challenges.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Senior Data Engineer (Pune)
🏢 Valuedx Technologies
📍 Pune