21 Nov
|
ValueLabs
|
Bengaluru
21 Nov
ValueLabs
Bengaluru
Job Summary We are looking for an experienced Cloudera Platform Engineer with strong hands-on production support and administration experience in Cloudera Data Platform (CDP) . The ideal candidate will have expertise in CDP installation, maintenance, security implementation, cluster optimization, automation, containerization, CI/CD practices, and troubleshooting big data workloads across enterprise environments.
Key Responsibilities
Install, configure, upgrade, and maintain Cloudera Data Platform (CDP) environments.
Manage and support CDP 7.1.9 or latest CDP versions across development, testing, and production environments.
Implement and maintain security configurations, governance controls, and compliance requirements within CDP.
Monitor and optimize Hadoop/Spark ecosystem performance, ensuring high availability and reliability.
Troubleshoot and resolve issues related to:
Spark Jobs
Hive Queries
YARN Applications
Cluster Performance
Collaborate with Data Engineers to optimize Spark workloads and improve processing efficiency.
Manage and support Cloudera Data Services (CDS) 1.5.4 and 1.5.5 .
Build automation solutions using Ansible, Shell Scripting, Python, Terraform, and Groovy .
Develop and maintain CI/CD pipelines for data and analytics platforms.
Implement observability, monitoring, logging, and alerting solutions.
Perform automated patching, security validation, and regulatory compliance checks.
Support containerized deployments using Docker,
Podman, Kubernetes, and OpenShift.
Participate in Agile ceremonies and contribute to continuous improvement initiatives.
Required Skills
Cloudera & Big Data
Cloudera Data Platform (CDP) Administration
Hadoop Ecosystem Administration
Cloudera Data Services (CDS)
Spark Performance Tuning
Hive & YARN Administration
Cluster Optimization & Maintenance
CDP Security & Governance
Automation & DevOps
Ansible
Terraform
Shell Scripting
Groovy
Python
Git/GitHub
CI/CD & Deployment
Jenkins
GitHub Actions
ArgoCD
CI/CD Pipeline Management
Containerization & Orchestration
Docker
Podman
Kubernetes
OpenShift (OCP)
Operating Systems
Linux Administration
Networking Concepts
System Monitoring & Observability
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field.
Minimum 5+ years of hands-on experience in Cloudera/Hadoop production environments.
Experience managing large-scale enterprise data platforms.
Strong troubleshooting and problem-solving abilities.
Positive communication and stakeholder management skills.
Preferred Qualifications
Exposure to Public Cloud platforms (AWS, Azure, GCP).
Experience supporting Data Science or Machine Learning platforms.
Knowledge of modern DataOps and Platform Engineering practices.
Certifications related to Cloudera, Hadoop, Kubernetes, or Cloud technologies.
📌 Platform Engineers - DevOps (Bengaluru)
🏢 ValueLabs
📍 Bengaluru