Location - Thane, Maharashtra, India (Mumbai Turbhe Office )
Full time Role
- Data Engineer role is to design, build, and maintain scalable, reliable, and efficient data infrastructure that enables real-time and batch data processing across cloud and on-premise environments.
- This role ensures that high-quality, well-structured data is readily available for analytics, reporting, and machine learning initiatives.
Responsibilities
- Design and implement scalable batch and streaming data pipelines using Kafka, Spark, and Airflow.
- Build real-time CDC pipelines with Debezium and Kafka Connect for near real-time replication.
- Ensure data quality and governance through validation checks and monitoring, maintaining compliance with standards.
- Manage data workflows across on-premise and cloud infrastructures for seamless integration.
- Contribute to data modeling and architecture supporting analytics and ML.
- Collaborate with data scientists, analysts, DevOps, and stakeholders to align solutions with business goals.
- Automate and optimize ingestion, transformation, and monitoring processes.
- Maintain detailed documentation and ensure secure data handling, complying with GDPR, HIPAA, and other regulations.
- Stay updated on emerging data engineering technologies.
Qualifications
Bachelor’s / Master’s degree in Engineering, Computer Science or relevant