Job Summary

Big Data Administrator

Key Responsibilities

Platform Installation & Configuration • Deploy, configure, and upgrade Hadoop distributions (Cloudera CDH, Hortonworks/DataPlane, or Cloud native equivalents). • Set up YARN, HDFS, Hive, Spark, HBase, ZooKeeper, Kafka, Oozie/Airflow, and related services. • Implement multi tenant resource pools and quota management. Operations & Monitoring • Build and maintain monitoring dashboards (Cloudera Manager, Ambari, Grafana, Prometheus) for capacity, health, latency, and job failure alerts. • Perform daily health checks, log analysis, and trend based capacity planning. Performance Tuning • Optimise Hadoop cluster parameters (block size, replication factor, YARN scheduler, Spark executor settings). • Tune Hive/Impala queries, Spark jobs, and HBase schema for banking workloads (transaction level reporting, fraud detection). Security & Compliance • Enforce authentication (Kerberos) and authorisation (Apache Ranger, Sentry). • Implement data in motion encryption (TLS), at rest encryption (HDFS transparent encryption), and audit logging. • Work with the Information Security team to satisfy PDPL, C Bank, and ISO 27001 audit requirements. Backup, Recovery & DR • Define and test backup strategies (DistCp, snapshots, cloud based tiering). • Manage disaster recovery (DR) replication (Cloudera Replicated HDFS, MirrorMaker for Kafka). Automation & Scripting • Develop reusable scripts (Bash, Python, PowerShell) or Ansible/Chef/Puppet playbooks for provisioning, patching, and routine maintenance. • Automate data ingestion pipelines (Sqoop, Flume, NiFi)



and job orchestration (Oozie/Airflow). Incident Management • Serve as Tier 2/Tier 3 escalation point for big data incidents; own end to end resolution and RCA documentation. • Communicate impact, mitigation steps, and ETA to stakeholders via ServiceNow and the DR Slack channel. Collaboration & Stakeholder Management • Partner with data engineering, data science, and business intelligence teams to provision environments, grant access, and resolve performance issues. • Liaise with vendors (Cloudera, Hortonworks, AWS, Azure) for support tickets, licensing, and POCs. Team Leadership & Knowledge Sharing • Mentor junior administrators; conduct internal “Big Data Ops” workshops and maintain run books on the secured SharePoint library. • Contribute to the Data Platform community of practice (code reviews, best practice documentation). Continuous Improvement • Identify opportunities for cost optimization (e.g., spot instance usage, tiered storage). • Evaluate emerging technologies (Kubernetes based data ops, Delta Lake, Lakehouse architecture) and propose proof of concepts.

Skill Requirements

8 years of hands on experience operating large scale Hadoop/Spark ecosystems ( 10 PB total storage). • 3 years in a lead or supervisory role (team of 3 8 DBAs/Admins).



• Prior experience in a banking or financial services environment is mandatory. • Deep knowledge of HDFS, YARN, MapReduce, Hive/Impala, Spark (standalone/YARN), HBase, ZooKeeper, Kafka, Oozie/Airflow. • Proficiency with Linux/Unix (RHEL/CentOS) administration, shell scripting, and Python/Perl. • Experience with Cloudera Manager / Hortonworks Ambari (or equivalent) for cluster lifecycle management. • Strong grasp of Kerberos, SSL/TLS, Apache Ranger/Sentry, Apache Knox for security. • Familiarity with cloud based big data services (AWS EMR, Azure HDInsight, Google Dataproc) and hybrid cloud integrations. • Working knowledge of data ingestion tools (Sqoop, Flume, NiFi), data movement (DistCp), and metadata/lineage (Apache Atlas, Cloudera Navigator). • Cloudera Certified Administrator (CCA Spark/Hadoop) – required. • Hortonworks Certified Apache Hadoop Administrator (HCAH) – preferred. • AWS Certified Big Data – Specialty or Azure Data Engineer Associate – optional. • ITIL Foundation – preferred.

Must Have Skill

MS SQL,MySQL,Oracle DB,PostgreSQL

Good to Have Skill

Other Requirements

Education Bachelor’s degree in Computer Science, Information Systems, Electrical Engineering, or related field. (Master’s degree preferred) Experience • 8 years of hands on experience operating large scale Hadoop/Spark ecosystems ( 10 PB total storage). • 3 years in a lead or supervisory role (team of 3 8 DBAs/Admins). • Prior experience in a banking or financial services workplace is mandatory.

📌 Senior Oracle Administrator - Oracle Administration,PostgreSQL,MYSQL, MS SQL (Sausar)
🏢 HCLTech
📍 Sausar