17 Nov
|
ALTIMETRIK
|
Mumbai
Senior Data Engineer AWS, Spark & Kafka
Experience: 813 years
Mandatory skills: SQL, Apache Spark, AWS, Apache Kafka, and data platform architecture
Work Mode: 5 days work from office
Notice period: Immediate to 20 days
Work Location: Only Mumbai
Role summary
We are looking for a hands-on Senior Data Engineer/ Data Architect to design, build, and operate batch and real-time data pipelines on AWS. You will own technical design decisions for data ingestion, processing, storage, and consumption. You will also implement production pipelines using Kafka, Spark, and SQL and work with stakeholders to translate business requirements into reliable data solutions.
Key responsibilities
- Design end-to-end data flows and document architecture decisions,
including service selection, data models, and integration patterns.
- Build and maintain batch and streaming pipelines using Apache Spark and Kafka on AWS.
- Develop and optimize complex SQL queries and transformations for analytics, reporting, and data validation.
- Design Kafka topics, partitioning strategies, and consumer groups. Handle schema changes, replay, and duplicate events in streaming pipelines.
- Tune Spark workloads for performance and cost by addressing partitioning, data skew, joins, and resource utilization.
📌 Data Architect (Mumbai)
🏢 ALTIMETRIK
📍 Mumbai