17 Nov
|
Tech Mahindra
|
Chennai
17 Nov
Tech Mahindra
Chennai
Role Overview
We are looking for a Python / Spark Data Engineer with strong hands-on experience in Spark-based data processing, production support, troubleshooting, and batch processing. The candidate should have exposure to contemporary data platforms and orchestration technologies, with the ability to debug and support data-processing applications in production environments.
Key Responsibilities
- Develop, support, troubleshoot, and debug Python and Spark-based data processing jobs.
- Provide production/application support for data engineering applications and batch processes.
- Monitor and support batch-processing workflows and resolve production issues.
- Work with Spark, Hive, and Data Warehouse load processes.
- Perform scheduling and batch orchestration using tools such as Airflow and Oozie.
- Work with Databricks and cloud-based data environments.
- Support data pipelines involving Kafka and related processes.
- Troubleshoot application and data-processing issues and perform root-cause analysis.
- Coordinate with users and relevant teams for timely resolution of production issues.
- Willing to work in 24/7 Shifts including night shifts
Required Technical Skills
- Python
- Apache Spark / PySpark
- Databricks
- Hive / Data Warehousing
- Kafka
- Airflow / Oozie
- Batch Processing & Scheduling
- Production / Application Support
- Troubleshooting & Debugging
- Cloud environment exposure
📌 Bigdata Application Support - Chennai/ Bangalore
🏢 Tech Mahindra
📍 Chennai