Ownership, maintenance, and support of a Hadoop data lake, supporting incident and problem resolution and providing end-to-end resolution to ensure completion of all jobs within defined objectives.
Coordination of platform maintenance, including change and release management (planned and emergency deployments, configuration, and patching)
Real-time system monitoring (custom and off-the-shelf tools) and engineer and implement.
custom monitoring solutions if needed.
Participation of Run books development
Engagement with applications development teams and other platform owners as necessary
Responsible to ensure that the applications met their required service level.
Responsible to support process improvements to continuously improve the stability and performance of the platform.
Identify system bottlenecks and opportunities for process improvements.
Perform in-depth research and identify sources of production issues.
Effectively perform root cause analysis of issues and report outcomes to business community and Management
Develop / utilize core support tools and processes to perform work while improving day-to-day practices for support team members with the goal of delivering service improvements to the business.
Key Desired Skills, Experience and Knowledge:
Extensive hands-on experience in designing, developing, and maintaining software solutions on Big Data platform such as Hadoop eco-system.
Experience with strong UNIX shell scripting
Experience with one of the IDE tools such as Eclipse.
Working experience with Spark and Scala/Python.
Preferred experience with developing Pig scripts/Hive QL, HBASE, SQOOP, UDF for analyzing all semi-structured/unstructured/structured data flows.
Preferred experience with developing MapReduce programs running on the Hadoop cluster Big Data Senior Developer using Java/Python.
Not mandatory but a big advantage to have prior experience using Talend with Hadoop technologies
7-10+ years of professional experience in IT
BS/BA Degree in Computer Science or related field
Strong communication skills, with prior experience in requirements gathering and working with SMEs and Stakeholders at various leadership level.
Strong experience with SDLC Methodology - Agile / Scrum / Iterative Development and utilization of Agile management tooling like JIRA. Be able to take user stories and work with teams to organize them into tasks, sprints, releases as well as some experience in backlog grooming, change management tasks, etc.
Knowledge of Data Modeling, Data Warehousing and ETL security and permission schemes
Knowledge of at least one RDBMS such as Hadoop, DB2 / Teradata
Exposure to Big Data patterns and data formats.
Ability to support project and/or product teams on functional and technical design activities; acting as Subject Matter Expert (SME); basic knowledge of project mgmt. functions
Sharp problem-solving, analytical and innovation skills
Strong oral/written communication skills with the ability to translate complex ideas into simple language for non-technicians
Keen leadership and project management skills, ability to drive projects from inception to completion
Previous experience from a management consulting environment desirable
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.
We are looking to hire a Senior Technical Lead with a minimum of 8 years' experience as a software developer minimum 2 years' experience in leading the team, and hands on experience in Nodejs & Angula [...]
Job Description The position is for a software engineer senior for big data work in SCA-V. SCA-V is vehicle data engineering team for SACHA and deals with Vehicle and mobility data engineering and tr [...]
Job Profile Job Description : About PayFort, an Important Company Company: We serve the needs of online shoppers in all Arabic speaking and surrounding countries through our trusted, secure pa [...]
Job Description Mandatory Certificate : 8 Years of Oracle DBA or APP DBA Experience (L3). Excellent understanding of Oracle database concepts. Experience handling prod databases like installing, m [...]