15 Nov
|
Smart Analytica
|
Mumbai
15 Nov
Smart Analytica
Mumbai
## Job highlights
- 7+ years experience with Cloudera Hadoop administration, expertise in cluster tuning, capacity planning, scripting (Shell/Python/Perl), and orchestration tools
- Install, configure, and manage Hadoop clusters; monitor performance and security; perform maintenance and upgrades; implement data ingestion; troubleshoot and collaborate with teams Role & responsibilities Role: CDP Hadoop Admin
- Lead Experience 7+ years Location
- BKC, Mumbai Work mode
- 5 Days Work from Office (FTE) Shift: Rotational(24*7) & 2 Rotational Week offs Job Summary: We are seeking an experienced CDP Hadoop Administrator
- Lead to manage and support our Hadoop ecosystem. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments. Key
Responsibilities:
- Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.
- Monitor and manage Hadoop cluster performance, capacity, and security.
- Perform routine maintenance tasks such as upgrades, patching, and backups.
- Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.
- Ensure high availability and disaster recovery of Hadoop clusters.
- Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.
- Troubleshoot and resolve issues related to the Hadoop ecosystem.
- Maintain documentation of Hadoop setting configurations, processes, and procedures. Requirement:
- Experience in Installing, configuring and tuning Hadoop distributions.
- Hands on experience in Cloudera.
- Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations.
- Provide Infrastructure Recommendations, Capacity Planning, work load management.
- Develop utilities to monitor cluster better Ganglia, Nagios etc.
- Manage large clusters with huge volumes of data
- Perform Cluster maintenance tasks
- Create and removal of nodes, cluster monitoring and troubleshooting
- Manage and review Hadoop log files
- Install and implement security for Hadoop clusters
- Install Hadoop Updates, patches and version upgrades. Automate the same through scripts
- Point of Contact for Vendor escalation. Work with Hortonworks in resolving issues
- Should have Conceptual/working knowledge of basic data management concepts like ETL, Ref/Master data, Data quality, RDBMS
- Working knowledge of any scripting language like Shell, Python, Perl
- Should have experience in Orchestration & Deployment tools. Academic Qualification:
- BE / B.
Tech in Computer Science or equivalent along with hands-on experience in dealing with large data sets and distributed computing in data warehousing and business intelligence systems using Hadoop.
📌 Senior Hadoop Administrator (Mumbai)
🏢 Smart Analytica
📍 Mumbai