Location: Bengaluru, India
Experience: 8+ Years

Job Overview:

We are looking for hands-on Tier-2 Production Engineer with robust Cloudera Data Platform (CDP) expertise to install, maintain, secure, and optimize enterprise Hadoop/Cloudera data platforms.

The role requires deep expertise across cluster administration, automation, containerization, platform security, observability, and collaboration with data engineering teams to ensure reliable and high-performing data services.

Key Responsibilities:

Cloudera & Data Platform Administration
Provide hands-on Tier-2 production support for Cloudera Data Platform (CDP).
Install, configure, maintain, and optimize the Cloudera environment.
Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
Support ongoing platform maintenance and operational stability.

Security & Compliance
Implement and maintain security requirements for CDP.
Automate security and regulatory checks.
Support secure operation of the enterprise data platform.

Performance Engineering
Optimize Cloudera cluster performance.
Work closely with data engineering teams to optimize Spark job performance.
Troubleshoot:
Spark jobs
Hive jobs
YARN jobs




Drive platform optimization and service reliability.

Containerization
Implement CDP containerization with data services.
Work with container technologies and enterprise container-management platforms.
Support Kubernetes/OpenShift-based environments.

Automation & CI/CD
Build automated pipelines and workflows for data projects.
Use tools such as:
GitHub Actions
Jenkins
ArgoCD
Similar CI/CD technologies
Python-based automation is preferred.
Drive automated patching and platform observability.

Required Skills & Experience:
8+ years of relevant experience, with the source specifically calling for 10+ years of hands-on Tier-2 production experience with Cloudera.
Solid Cloudera/CDP administration experience.
Experience developing automation using:
Shell
Terraform
Groovy
Ansible
Experience with containerization technologies including:
Podman
Docker
OCP
Experience with container management using:
Kubernetes
OpenShift
Solid Linux operating system and networking fundamentals.
Proficiency with Git and Agile engineering practices.

Apply Now: [email protected]

📌 Senior Technology Engineer – Devops Data Hadoop Bengaluru (India)
🏢 D4 Insight
📍 India