Location: Bengaluru, India

Experience: 8+ Years

Job Overview

We are looking for hands-on Tier-2 Production Engineer with strong Cloudera Data Platform (CDP) expertise to install, maintain, secure, and optimize enterprise Hadoop/Cloudera data platforms.

The role requires deep expertise across cluster administration, automation, containerization, platform security, observability, and collaboration with data engineering teams to ensure reliable and high-performing data services.

Key Responsibilities

Cloudera &

- Data Platform Administration

- Provide hands-on Tier-2 production support for Cloudera Data Platform (CDP).
- Install, configure, maintain, and optimize the Cloudera environment.
- Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
- Support ongoing platform maintenance and operational stability.

Security &
- Compliance

- Implement and maintain security requirements for CDP.
- Automate security and regulatory checks.
- Support secure operation of the enterprise data platform.

Performance Engineering
- Optimize Cloudera cluster performance.
- Work closely with data engineering teams to optimize Spark job performance.
- Troubleshoot:
- Spark jobs
- Hive jobs
- YARN jobs





- Drive platform optimization and service reliability.

Containerization
- Implement CDP containerization with data services.
- Work with container technologies and enterprise container-management platforms.
- Support Kubernetes/OpenShift-based environments.

Automation &
- CI/CD

- Build automated pipelines and workflows for data projects.
- Use tools such as:
- GitHub Actions
- Jenkins
- ArgoCD
- Similar CI/CD technologies

- Python-based automation is preferred.
- Drive automated patching and platform observability.

Required Skills &

- Experience

- 8+ years of relevant experience, with the source specifically calling for 10+ years of hands-on Tier-2 production experience with Cloudera.
- Solid Cloudera/CDP administration experience.
- Experience developing automation using:
- Shell
- Terraform
- Groovy
- Ansible

- Experience with containerization technologies including:

- Podman
- Docker
- OCP

- Experience with container management using:

- Kubernetes
- OpenShift

- Strong Linux operating system and networking fundamentals.
- Proficiency with Git and Agile engineering practices.

? Apply Now: [email protected]

📌 Senior Technology Engineer – DevOps Data Hadoop (Bengaluru)
🏢 D4 Insight
📍 Bengaluru