08 Sep
|
Mobikwik
|
Gurugram
Role & responsibilities
1.Data Infrastructure: Build and maintain scalable, secure, and high-performance data platforms on AWS (Glue, Redshift, S3, EMR, Athena). Ensure systems are reliable, cost-efficient, and meet business
SLAs.
1. Data Pipelines: Design and implement ETL/ELT workflows to ingest, process, and transform large structured and unstructured datasets from multiple sources (transactional DBs, APIs, logs, Kafka).
Enable both batch and real-time data streaming solutions.
1. Data Modeling & Warehousing: Develop effective data models and schemas to support analytics, BI, and reporting.
Optimize storage and queries in Redshift, Hive, or MySQL.
1. Performance & Optimization: Continuously tune data processing frameworks (Pyspark, Glue, Kafka, Hive) to ensure performance, scalability, and cost-effectiveness.
2. Collaboration: Partner with data scientists, product managers, and analysts to translate requirements into scalable data solutions. Ensure data availability and accessibility for experimentation, insights,
and decision-making.
1. Quality & Monitoring: Implement robust monitoring, alerting,
and data validation frameworks to ensure data integrity, reliability, and availability.
2. Team Mentorship: Guide junior engineers with technical reviews, coding best practices, and architecture discussions. Foster a culture of innovation, ownership, and continuous improvement.
Preferred candidate profile Bachelors or Masters degree in Computer Science, Engineering, or related field.
6–9 years of experience in Data Engineering, with hands-on expertise in:
- Python, Pyspark, SQL, Shell scripting
- AWS data stack (Glue, Redshift, Athena, EMR, S3)
- Streaming technologies (Kafka, Kinesis)
- ETL/ELT frameworks and data orchestration tools (Airflow, Step Functions).
- Strong understanding of databases (MySQL, MongoDB, Hive, NoSQL) and query optimization.
- Proven experience designing and scaling data pipelines for large volumes of data.
- Excellent problem-solving, debugging, and performance-tuning skills.
- Ability to mentor, influence, and lead while remaining hands-on with code.
📌 Lead Data Engineer (Gurugram)
🏢 Mobikwik
📍 Gurugram