Senior Technology Engineer Hadoop / CDP & DevOps

Role Overview

We are looking for a Senior Technology Engineer with solid hands-on experience in Hadoop and Cloudera Data Platform (CDP), complemented by DevOps and automation expertise. The role will focus primarily on CDP cluster administration, performance optimization, security, troubleshooting, automation, and containerized data services in a production environment.

The ideal candidate will work closely with Data Engineering and Platform teams to ensure highly available, secure, performant, and automated data platforms.

Key Responsibilities

Cloudera Data Platform / Hadoop
- Install, configure, upgrade, and maintain Cloudera Data Platform (CDP) clusters in production environments.
- Work with CDP 7.1.7+ and/or the latest available CDP versions.
- Configure and maintain Cloudera Data Services 1.5.4 / 1.5.5 or later.
- Implement and maintain CDP security requirements, including authentication, authorization, encryption, and security controls.
- Monitor and optimize cluster health, capacity, resource utilization,



and overall performance.
- Troubleshoot complex issues across Spark, Hive, YARN, and Hadoop ecosystem components.
- Analyze and resolve Spark job performance issues in collaboration with Data Engineers.
- Perform cluster capacity planning, tuning, patching, upgrades, and maintenance activities.
- Support CDP containerization and containerized data services.

DevOps & Automation
- Develop and maintain automation using Ansible, Shell scripting, Terraform, Groovy, and Python.
- Automate CDP provisioning, configuration, patching, maintenance, and operational tasks.
- Build and maintain CI/CD pipelines and automated workflows for data and analytics projects.
- Work with tools such as GitHub Actions, Jenkins, and Argo CD.
- Automate security, compliance, and regulatory checks.
- Implement automated patching and configuration management processes.
- Apply Infrastructure as Code and DevOps best practices to dat

📌 Senior Technology Engineer (Delhi)
🏢 Deloitte Shared Services India
📍 Delhi