*1.3+ years hands-on development in big data technologies. Understand Hadoop Architecture specifically HortonWorks.
2. Must have knowledge of Unix shell scripting.
3. Experienced in coding automation scripts using Python, Puppet, Shell scripting. Must have Knowledge of Linux operating system and shell scripting*
Auto Owners is looking for a long-term contractor with strong Hadoop development experience to join their existing data lake project. Auto Owners is in the process of creating a data lake and had initially brought on a consultant boutique firm to do a lot of this work but it has not worked out and they would like us to help them fill these roles.They need us to identify someone who will be expected to mentor other AO associates as they are ramping up on Hadoop development. Because of the mentoring that is expected, this person will need very positive communication skills in addition to the technical experience. This is a huge opportunity for us to get back in a large project that we had lost the ability to work on.
There are three open roles and they can look at contract or contract to hire if anyone is interested in joining AO. This project will run for several years.f
o Sr. Hadoop Developer:
Job Description
v Troubleshoot and debug Hadoop ecosystem run time issues.
v Collaborate in developing best practices/templates/patterns.
v Mentor other team members.
Hands on experience with HiveQL and Hive optimization techniques.
Ability to write Pig Latin scripts.
Expertise with data loading tools like Sqoop and Flume.
Build distributed, reliable and scalable data pipelines to ingest and process data in real-time using Kafka.
Knowledge of workflow/schedulers like Oozie.
Hands on experience with Spark libraries.
Solid understanding of Hadoop architecture.
Experience working with REST API.
Hands-on experience with Java and Python.
Must have knowledge of Unix shell scripting.
Solid understanding of ETL, its variations and data warehousing techniques