Position Description:
Role Summary
We are seeking a skilled Production Support Engineer (Hadoop) with strong expertise in Big Data ecosystem support, job monitoring, and troubleshooting. The ideal candidate will have hands on experience with Hadoop services, Linux administration, and Spark based application debugging, along with exposure to scheduling tools and incident management systems.
Experience: 3–5 Years
Location: Hyderabad
Work: 24/7 Rotational shift, 5 days work from office in ODC environment, L1/L2 support, No hybrid access.
Key Responsibilities
. Monitor and manage batch jobs using CA7 scheduler, including tracking job failures and analyzing CA7 logs
. Perform incident management and ticket handling using ServiceNow, ensuring timely resolution and SLA adherence
. Troubleshoot and support Hadoop ecosystem components such as YARN, Hive, and Impala
. Debug and resolve issues in PySpark jobs, including performance tuning and error analysis
. Work with HDFS and HQL (HDFS SQL / Hive queries) for data validation and issue resolution
.
Develop and maintain shell scripts for automation and operational tasks
. Analyze system logs and identify root causes of failures across the Big Data platform
. Collaborate with development, infrastructure, and support teams for issue resolution and system improvements
Required Skills & Qualifications
. Solid experience in Linux (RHEL) administration and command line operations
. Hands on experience with Hadoop ecosystem components:
. Proficiency in PySpark, with solid debugging and troubleshooting skills
. Experience with CA7 job scheduling and monitoring
. Knowledge of Shell scripting for automation
. Familiarity with ServiceNow or similar ticketing tools
. Good understanding of data processing workflows and ETL pipelines
Skills:
- Communication
- Infrastructure
- Hadoop Ecosystem (HDFS)
- Hadoop Hive
- Linux
What you can expect from us:
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is
📌 Production Support Engineer (Hyderabad)
🏢 CGI
📍 Hyderabad