Technical Skillsets

- Experience with the full Cloudera CDH distribution to install, configure and monitor all services in the CDH stack.
- (Cloudera CDP 7.x/Hadoop 3 software stack) Experience with multiple large scale Enterprise Hadoop environment builds and operations including design, capacity planning, cluster set up, security, performance tuning and monitoring.
- Strong understanding of core Cloudera Hadoop services such as HDFS, MapReduce, YARN, Kafka, Spark and Spark-Streaming, Hive, Impala, HBASE, Kudu, Sqoop, and Oozie.
- Experience in administering, and supporting RHEL Linux operating systems, databases, and hardware in an enterprise environment.
- Experience with Hadoop distributions in the Cloud is a plus, AWS, Azure, Google.
- Experienced in the configuration management for the nodes
- Experienced in cluster management monitoring via Cloudera Manager / Ambari or conventional tools like Ganglia or Nagios
- Knowledge of disaster recovery related to Hadoop platforms Good knowledge on SQL queries.
- Understanding of modern programming languages such as Python, Spark, Knowledge on Automation tools

Roles and Responsibilities

- Building new clusters / projects involving installation and/or configuration of CDH technologies
- Accountable for storage, performance tuning and volume management of Hadoop clusters




- Involves designing, capacity arrangement, cluster set up, performance fine-tuning, monitoring, structure planning, scaling, and administration
- Should take care of the standard System Admin work like creating recent users in Hadoop, handling permissions, performing upgrades
- Should take care of the day-to-day Cluster issues like finding out which jobs are taking more time if users say that jobs are stuck to find out the reason
- Should take care of the daily supporting of users in their admin needs.
- This would involve checking for heavy jobs and if some jobs are taking more time as per the SLA.
- SQL and performance tuning at all levels Work with cross-functional teams to set up a production environment and enable solutions for business.
- Perform Tuning and increase Operational efficiency on a continuous basis. Interact with business users to answer their queries and solve their problems. Develop scripts to automate reports and maintenance activities.
- Implement backup and recovery strategies based on Cloudera Replication Manager
- Solve live performance and stability issues and prevent recurrence
- Ability to support data engineering efforts and ETL pipelines Ability to support data science teams using Python, Scala

📌 Cdp Administrator (Bengaluru)
🏢 Iqvia
📍 Bengaluru