Educational Requirements

Bachelor of Engineering

Service Line

Data Analytics Unit

Responsibilities

- Install, configure, and maintain Hadoop clusters (HDFS, YARN, MapReduce).
- Administer Hadoop ecosystem components such as Hive, HBase, Spark, Sqoop, Kafka, and Oozie.
- Monitor cluster health, performance, and storage capacity using tools like Ambari, Cloudera Manager, or similar.
- Configure and manage HDFS storage, replication, and data balancing.
- Implement and maintain security policies (Kerberos authentication, encryption, access controls).
- Perform cluster upgrades, patching, and capacity planning.
- Troubleshoot issues related to cluster performance, jobs, and data processing failures.
- Manage data ingestion and pipeline workflows.
- Ensure high availability and disaster recovery for Hadoop clusters.
- Collaborate with data engineers and architects for performance optimization and system improvements.
- Maintain documentation for cluster configurations and processes.

Technical and Professional Requirements
- 25 years of experience in Hadoop Administration / Big Data Platforms.




- Solid knowledge of Hadoop ecosystem components (HDFS, YARN, Hive, Spark).
- Hands-on experience with cluster management tools (Cloudera Manager, Ambari).
- Good understanding of Linux/Unix systems administration.
- Proficiency in shell scripting for automation and monitoring.
- Experience with performance tuning, troubleshooting, and cluster optimization.
- Familiarity with data ingestion tools (Sqoop, Kafka, Flume).
- Knowledge of distributed computing concepts and data storage systems.
- Understanding of networking and system architecture in distributed environments.
- Certifications such as Cloudera Certified Administrator (CCA) or equivalent.
- Experience with cloud-based Hadoop platforms (Azure HDInsight, AWS EMR, GCP Dataproc).
- Knowledge of DevOps practices and CI/CD pipelines.
- Exposure to containerization tools (Docker, Kubernetes) is a plus.
- Familiarity with data warehousing and ETL processes.

Preferred Skills
- Technology->Big Data - Hadoop->Hadoop Administration->Hadoop

📌 Hadoop Admin (Karnataka)
🏢 Infosys
📍 Karnataka