23 Oct
|
ValueLabs
|
Bengaluru
23 Oct
ValueLabs
Bengaluru
Job Title: Cloudera Platform Engineer / CDP Administrator
Experience: 5+ Years
Location: India (Hybrid)
Domain: Data & Technology Platforms
Job Summary
We are looking for an experienced Cloudera Platform Engineer with strong hands-on production support and administration experience in Cloudera Data Platform (CDP). The ideal candidate will have expertise in CDP installation, maintenance, security implementation, cluster optimization, automation, containerization, CI/CD practices, and troubleshooting big data workloads across enterprise environments.
Key Responsibilities
- Install, configure, upgrade, and maintain Cloudera Data Platform (CDP) environments.
- Manage and support CDP 7.1.9 or latest CDP versions across development, testing, and production environments.
- Implement and maintain security configurations, governance controls, and compliance requirements within CDP.
- Monitor and optimize Hadoop/Spark ecosystem performance, ensuring high availability and reliability.
- Troubleshoot and resolve issues related to:
- Spark Jobs
- Hive Queries
- YARN Applications
- Cluster Performance
- Collaborate with Data Engineers to optimize Spark workloads and improve processing efficiency.
- Manage and support Cloudera Data Services (CDS) 1.5.4 and 1.5.5.
- Build automation solutions using Ansible, Shell Scripting, Python, Terraform, and Groovy.
- Develop and maintain CI/CD pipelines for data and analytics platforms.
- Implement observability, monitoring, logging, and alerting solutions.
- Perform automated patching, security validation,
and regulatory compliance checks.
- Support containerized deployments using Docker, Podman, Kubernetes, and OpenShift.
- Participate in Agile ceremonies and contribute to continuous improvement initiatives.
Required Skills
Cloudera & Big Data
- Cloudera Data Platform (CDP) Administration
- Hadoop Ecosystem Administration
- Cloudera Data Services (CDS)
- Spark Performance Tuning
- Hive & YARN Administration
- Cluster Optimization & Maintenance
- CDP Security & Governance
Automation & DevOps
- Ansible
- Terraform
- Shell Scripting
- Groovy
- Python
- Git/GitHub
CI/CD & Deployment
- Jenkins
- GitHub Actions
- ArgoCD
- CI/CD Pipeline Management
Containerization & Orchestration
- Docker
- Podman
- Kubernetes
- OpenShift (OCP)
Operating Systems
- Linux Administration
- Networking Concepts
- System Monitoring & Observability
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum 5+ years of hands-on experience in Cloudera/Hadoop production environments.
- Experience managing large-scale enterprise data platforms.
- Strong troubleshooting and problem-solving abilities.
- Positive communication and stakeholder management skills.
Preferred Qualifications
- Exposure to Public Cloud platforms (AWS, Azure, GCP).
- Experience supporting Data Science or Machine Learning platforms.
- Knowledge of modern DataOps and Platform Engineering practices.
- Certifications related to Cloudera, Hadoop, Kubernetes, or Cloud technologies.
📌 Cloudera Platform Engineer (Bengaluru)
🏢 ValueLabs
📍 Bengaluru