- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies
- Write and tune complex Java, MapReduce, Pig and Hive jobs
- Adapt quickly to change in requirements and be willing to work with different technologies if required
- Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very key
- Lead the effort to build, implement and support the data infrastructure
- Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develops top-quality dashboards using industry best practices
- Manage team of data engineers (both full-time associates and/or third party resources)
- Own the majority of deliverables for the Big Data team from a delivery perspective
- Analyzes and confirms the integrity of source data to be evaluated
- Leads in deployment and auditing models and attributes for accuracy
Education for Lead Data Engineer :
Have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Statistics, Education, Technical, Information Technology, Information Systems, Mathematics, Computer Engineering, Management
Skills for Lead Data Engineer :
Desired skills for lead data engineer include :
- Python
- Spark
- Java
- Hive
- SQL
- Hadoop architecture
- Large scale search applications and building high volume data pipelines
- Message queuing
- NoSQL
- Scala
Desired experience for lead data engineer includes :
- Experience in development utilizing C# .NET 4.5
- Experience in managing a live service that customers depend
- Experience in coaching and managing other engineers
- Be a team player and enjoy collaboration with other engineers and teams
- Experience with software version management systems
- Experience with task/bug tracking software
Exp : 5-7yrs
📌 Lead Data Engineer - Spark/Python (New Delhi)
🏢 Unicon Connectors
📍 New Delhi
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.