27 Sep
|
Dataspan Technologies
|
Mumbai
27 Sep
Dataspan Technologies
Mumbai
Location: Mumbai, Maharashtra
Experience: 5+ Years
Employment Type: Full-Time
Work Mode: On-site
Job Level: Individual Contributor
About the RoleWe are looking for a Senior Data Engineer to design, develop, and implement scalable, real-time and batch data integration pipelines.
The role will focus on connecting and harmonizing data across diverse ERP systems, using event-driven architectures to enable high-throughput, low-latency, and reliable data movement across enterprise platforms.
Key Responsibilities
- Design, build, and deploy scalable real-time and batch data pipelines integrating multiple ERP systems with downstream data platforms and data lakes.
- Build event-driven data processing systems using Apache Kafka, Kafka Connect, Kafka Streams, or Apache Flink.
- Work with Change Data Capture (CDC) and transactional data at scale.
- Develop resilient microservices and integration layers using Java and Spring Boot.
- Build and manage containerized applications using Docker and Kubernetes.
- Design and optimize databases across PostgreSQL, MySQL, SQL Server, and Oracle.
- Develop and maintain Infrastructure as Code (IaC) using Terraform or AWS CloudFormation.
- Build and manage automated CI/CD pipelines using GitHub Actions.
- Implement monitoring, logging, tracing, alerting, and observability using tools such as DataDog, New Relic, or Splunk.
- Collaborate with cross-functional IT and engineering teams and independently drive technical solutions.
Required Skills & Experience
- 5+ years of hands-on experience in software/data engineering.
- Strong proficiency in Java and Spring Boot.
- Strong programming experience with Python.
- Hands-on experience with Apache Kafka and Kafka Connect.
- Experience with Kafka Streams or Apache Flink.
- Strong understanding of CDC and event-driven architectures.
- Hands-on experience with Docker and Kubernetes.
- Strong knowledge of relational databases and query optimization.
- Experience with PostgreSQL, MySQL, SQL Server, or Oracle.
- Hands-on experience deploying applications and data workloads on AWS.
- Experience with Terraform or AWS CloudFormation.
- Experience managing CI/CD workflows using GitHub Actions.
- Advanced proficiency with Git and collaborative development workflows.
- Experience with production monitoring and observability tools such as DataDog, New Relic, or Splunk.
Education
- Bachelor's degree in Computer Science, Information Technology, or a related technical field is preferred.
- Relevant professional experience may be considered in lieu of a degree.
What We’re Looking For
- Robust problem-solving and system-design skills.
- Ability to work independently with limited direction.
- Strong communication and collaboration skills.
- Ability to influence and work effectively with cross-functional teams.
- Experience working with high-volume, distributed, and production-grade data systems.
📌 Senior Data Engineer (Mumbai)
🏢 Dataspan Technologies
📍 Mumbai