06 Aug
|
Smart IMS
|
India
Role Overview :
We are looking for a Lead Data Engineer to join one of the largest E-commerce platform companies. You will lead engineering teams and drive architecture decisions for large-scale distributed data platforms.
Required Qualifications :
- 7-10 years of experience in Data Engineering or Big Data.
- 2+ years of experience leading engineering teams or technical projects.
- Experience building large-scale distributed data platforms.
Technical Skills :
- Programming : Scala, SQL
- Big Data : Apache Spark (Core, SQL, Streaming), Apache Flink
- Cloud : GCP (DataProc, BigQuery, GCS) or AWS/Azure
- Containerization : Kubernetes, Docker
- Lakehouse : Apache Iceberg, Apache Hudi, Delta Lake
- Strong knowledge of Data Warehousing, Dimensional Modeling, Data Lakes, and Lakehouse Architecture.
Leadership Skills :
- Robust leadership, mentoring, stakeholder management, and communication skills.
- Ability to drive architecture decisions, manage cross-functional teams, and deliver complex engineering programs.
- Strong analytical, problem-solving, and project management capabilities.
Education :
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
Preferred Qualifications :
- Experience with Apache Airflow, Argo Workflows, or Azkaban.
- Exposure to CI/CD, MLOps, Feature Stores, and real-time analytics platforms (Druid, ClickHouse, HBase).
- Experience in large-scale eCommerce, Retail, FinTech, or Internet organizations.
- Knowledge of GenAI, LLMs, and Agentic AI is a strong advantage.
📌 Smart IMS - Lead Data Engineer - Big Data (India)
🏢 Smart IMS
📍 India