Educational Requirements

Bachelor of Engineering

Service Line

Data Analytics Unit

Responsibilities
Install, configure, and maintain Hadoop clusters (HDFS, YARN, MapReduce).
Administer Hadoop ecosystem components such as Hive, HBase, Spark, Sqoop, Kafka, and Oozie.
Monitor cluster health, performance, and storage capacity using tools like Ambari, Cloudera Manager, or similar.
Configure and manage HDFS storage, replication, and data balancing.
Implement and maintain security policies (Kerberos authentication, encryption, access controls).
Perform cluster upgrades, patching, and capacity planning.
Troubleshoot issues related to cluster performance, jobs, and data processing failures.
Manage data ingestion and pipeline workflows.
Ensure high availability and disaster recovery for Hadoop clusters.
Collaborate with data engineers and architects for performance optimization and system improvements.
Maintain documentation for cluster configurations and processes.

Technical and Qualified Requirements
25 years of experience in Hadoop Administration / Big Data Platforms.




Solid knowledge of Hadoop ecosystem components (HDFS, YARN, Hive, Spark).
Hands-on experience with cluster management tools (Cloudera Manager, Ambari).
Positive understanding of Linux/Unix systems administration.
Proficiency in shell scripting for automation and monitoring.
Experience with performance tuning, troubleshooting, and cluster optimization.
Familiarity with data ingestion tools (Sqoop, Kafka, Flume).
Knowledge of distributed computing concepts and data storage systems.
Understanding of networking and system architecture in distributed environments.
Certifications such as Cloudera Certified Administrator (CCA) or equivalent.
Experience with cloud-based Hadoop platforms (Azure HDInsight, AWS EMR, GCP Dataproc).
Knowledge of DevOps practices and CI/CD pipelines.
Exposure to containerization tools (Docker, Kubernetes) is a plus.
Familiarity with data warehousing and ETL processes.

Preferred Skills
Technology->Big Data - Hadoop->Hadoop Administration->Hadoop

📌 Hadoop Admin Karnataka
🏢 Infosys
📍 Karnataka