06 Sep
|
D4 Insight
|
Bengaluru
06 Sep
D4 Insight
Bengaluru
Location: Bengaluru, India
Experience: 8+ Years
Job Overview
We are looking for hands-on Tier-2 Production Engineer with strong Cloudera Data Platform (CDP) expertise to install, maintain, secure, and optimize enterprise Hadoop/Cloudera data platforms.
The role requires deep expertise across cluster administration, automation, containerization, platform security, observability, and collaboration with data engineering teams to ensure reliable and high-performing data services.
Key Responsibilities
Cloudera & Data Platform Administration
Provide hands-on Tier-2 production support for Cloudera Data Platform (CDP).
Install, configure, maintain, and optimize the Cloudera environment.
Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
Support ongoing platform maintenance and operational stability.
Security & Compliance
Implement and maintain security requirements for CDP.
Automate security and regulatory checks.
Support secure operation of the enterprise data platform.
Performance Engineering
Optimize Cloudera cluster performance.
Work closely with data engineering teams to optimize Spark job performance.
Troubleshoot:
Spark jobs
Hive jobs
YARN jobs
Drive platform optimization and service reliability.
Containerization
Implement CDP containerization with data services.
Work with container technologies and enterprise container-management platforms.
Support Kubernetes/OpenShift-based environments.
Automation & CI/CD
Build automated pipelines and workflows for data projects.
Use tools such as:
GitHub Actions
Jenkins
ArgoCD
Similar CI/CD technologies
Python-based automation is preferred.
Drive automated patching and platform observability.
Required Skills & Experience
8+ years of relevant experience, with the source specifically calling for 10+ years of hands-on Tier-2 production experience with Cloudera.
Solid Cloudera/CDP administration experience.
Experience developing automation using:
📌 Senior Technology Engineer – DevOps Data Hadoop (Bengaluru)
🏢 D4 Insight
📍 Bengaluru