14 Aug
|
Info Services
|
Bengaluru
14 Aug
Info Services
Bengaluru
: Platform Administrator EMR (Hadoop) &
- Big Data (4–6 Years)
Experience
4–6 years of experience in platform administration, production support, and Big Data ecosystems
Location: Offshore
________________________________________
Role Overview
We are seeking a mid-level Hadoop / EMR Platform Administrator with strong hands-on experience in managing Big Data platforms. The candidate will focus on day-to-day operations, monitoring, troubleshooting, and performance tuning of Hadoop clusters while collaborating with senior engineers on improvements and automation.
________________________________________
Key Responsibilities
Big Data Platform Administration
- Support and administer AWS EMR (Hadoop ecosystem) clusters
- Manage Hadoop components: HDFS, YARN, Hive, Spark, MapReduce
- Perform routine tasks like cluster monitoring, health checks, and job tracking
- Assist in cluster setup, scaling, and performance tuning
- Ensure system availability and data reliability
- Hadoop admins typically handle cluster lifecycle, monitoring, and performance optimization tasks [torchora.com]
________________________________________
AWS &
- Linux Infrastructure
- Manage Linux systems (RHEL/CentOS/Ubuntu)
- Work with AWS services: EC2, S3, IAM, VPC, CloudWatch
- Perform OS patching, system upgrades, and basic hardening
- Monitor resource utilization and support cost optimization
- AWS admins are responsible for resource provisioning, security, monitoring, and troubleshooting in cloud environments
________________________________________
Distributed Systems &
- Middleware
- Assist in managing Zookeeper clusters
- Support Solr / search platforms (basic configuration & troubleshooting)
- Troubleshoot common distributed system issues (node failures, latency, data inconsistencies)
________________________________________
Application &
- Services Management
- Deploy and maintain Apache Tomcat servers
- Support Java application deployments
- Perform basic JVM monitoring and log analysis
________________________________________
Monitoring &
- Automation
- Use monitoring tools: CloudWatch, Grafana, ELK, Prometheus
- Monitor cluster health and job execution
- Automate repetitive tasks using Shell scripting / Python
- Automation and monitoring are key to maintaining stable and scalable Hadoop environments [torchora.com]
________________________________________
Production Support
- Provide L2 support with occasional L3 contributions
- Troubleshoot failures and perform Root Cause Analysis (RCA)
- Handle tickets, incidents, and service requests
- Work in on-call rotation
- Hadoop admins are responsible for troubleshooting, system reliability, and operational support [educba.com]
________________________________________
Required Skills &
- Expertise
Core Skills
- Strong experience in Linux administration
- Hands-on with AWS EMR and Hadoop ecosystem
- Knowledge of HDFS, YARN, Hive, Spark
- Basic understanding of distributed systems
- Scripting: Shell / Python
- Familiarity with monitoring tools
________________________________________
Big Data Skills
- Understanding of:
o Hadoop architecture o Data ingestion (Sqoop / Flume – optional exposure)
o Job scheduling and execution
- Hadoop administrators often work with ingestion tools, scheduling, and ecosystem components [velvetjobs.com]
________________________________________
Good to Have
- Exposure to Docker / Kubernetes
- Basic knowledge of CI/CD pipelines
- Familiarity with Terraform / CloudFormation
- Understanding of ETL processes and data pipelines
________________________________________
Soft Skills
- Robust troubleshooting and analytical skills
- Ability to work in production environments under pressure
- Good communication and collaboration skills
- Willingness to learn and grow into senior roles
________________________________________
Preferred Qualifications
- Bachelor’s degree in Computer Science / IT
- AWS certification (preferred but not mandatory)
- Exposure to enterprise Big Data platforms
📌 EMR Platform Administrator/ Hadoop Admin (Bengaluru)
🏢 Info Services
📍 Bengaluru