09 Sep
|
Mobikwik
|
Gurugram
Role & responsibilities
1.Data Infrastructure: Build and maintain scalable, secure, and high-performance data platforms on AWS (Glue, Redshift, S3, EMR, Athena). Ensure systems are reliable, cost-effective, and meet business
SLAs.
Data Pipelines: Design and implement ETL/ELT workflows to ingest, process, and transform large structured and unstructured datasets from multiple sources (transactional DBs, APIs, logs, Kafka).
Enable both batch and real-time data streaming solutions.
Data Modeling & Warehousing: Develop effective data models and schemas to support analytics, BI, and reporting.
Optimize storage and queries in Redshift, Hive, or MySQL.
Performance & Optimization: Continuously tune data processing frameworks (Pyspark, Glue, Kafka, Hive) to ensure performance, scalability, and cost-effectiveness.
Collaboration: Partner with data scientists, product managers, and analysts to translate requirements into scalable data solutions. Ensure data availability and accessibility for experimentation, insights,
and decision-making.
Quality & Monitoring: Implement robust monitoring, alerting,
and data validation frameworks to ensure data integrity, reliability, and availability.
Team Mentorship: Guide junior engineers with technical reviews, coding best practices, and architecture discussions. Foster a culture of innovation, ownership, and continuous improvement.
Preferred candidate profile Bachelors or Masters degree in Computer Science, Engineering, or related field.
6–9 years of experience in Data Engineering, with hands-on expertise in:
Python, Pyspark, SQL, Shell scripting
AWS data stack (Glue, Redshift, Athena, EMR, S3)
Streaming technologies (Kafka, Kinesis)
ETL/ELT frameworks and data orchestration tools (Airflow, Step Functions).
Solid understanding of databases (MySQL, MongoDB, Hive, NoSQL) and query optimization.
Proven experience designing and scaling data pipelines for large volumes of data.
Excellent problem-solving, debugging, and performance-tuning skills.
Ability to mentor, influence, and lead while remaining hands-on with code.
📌 Lead Data Engineer Gurugram
🏢 Mobikwik
📍 Gurugram