18 Nov
|
ValueLabs
|
Bengaluru
18 Nov
ValueLabs
Bengaluru
Cloudera Platform Engineer / CDP Administrator
Job Summary
We are looking for an experienced Cloudera Platform Engineer with 5+ years of hands-on experience in Cloudera Data Platform (CDP) and Hadoop production environments. The candidate should have strong expertise in CDP administration, cluster maintenance, security, performance tuning, automation, CI/CD, and containerization, with experience supporting large-scale enterprise data platforms.
Key Responsibilities
- Install, configure, upgrade, and maintain Cloudera Data Platform (CDP) environments.
- Administer CDP 7.1.9 and newer versions across development, testing, and production environments.
- Manage Cloudera Data Services (CDS) and enterprise Hadoop ecosystem components.
- Implement platform security, governance, access controls, and compliance requirements.
- Monitor and optimize Hadoop, Spark, Hive, and YARN workloads.
- Troubleshoot Spark jobs, Hive queries, YARN applications, and cluster performance issues.
- Collaborate with Data Engineers to optimize Spark workloads and processing efficiency.
- Automate platform administration, patching, and provisioning using Ansible, Terraform, Shell, Python, and Groovy.
- Develop and maintain CI/CD pipelines using Jenkins, GitHub Actions, and ArgoCD.
- Implement monitoring, logging, observability, and alerting solutions.
- Support containerized deployments using Docker, Podman, Kubernetes, and OpenShift.
- Perform security validation, patching, and regulatory compliance checks.
- Participate in Agile ceremonies and continuous improvement initiatives.
Required Skills
Cloudera & Big Data
- Cloudera Data Platform (CDP) Administration
- Hadoop Ecosystem Administration
- Cloudera Data Services (CDS)
- Spark Performance Tuning
- Hive and YARN Administration
- Cluster Optimization and Maintenance
- CDP Security and Governance
Automation & DevOps
- Ansible, Terraform
- Shell Scripting, Python, Groovy
- Git / GitHub
CI/CD
- Jenkins
- GitHub Actions
- ArgoCD
- CI/CD Pipeline Management
Containerization & Infrastructure
- Docker, Podman
- Kubernetes, OpenShift (OCP)
- Linux Administration
- Networking Concepts
- System Monitoring and Observability
Preferred Skills
- Exposure to AWS, Azure, or GCP.
- Experience supporting Data Science or Machine Learning platforms.
- Knowledge of DataOps and Platform Engineering practices.
- Cloudera, Hadoop, Kubernetes, or Cloud certifications.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5+ years of hands-on experience in Cloudera/Hadoop production environments.
- Experience managing large-scale enterprise data platforms.
- Solid troubleshooting, problem-solving, communication, and stakeholder management skills.
📌 Cloudera Platform Engineer (Bengaluru)
🏢 ValueLabs
📍 Bengaluru