Freelancing Prospect

Job Description: Big Data & Python Support Consultant

Experience: 4–8 Years

Job Summary

We are looking for an experienced Big Data & Python Support Consultant with solid hands-on expertise in Python, PySpark, Apache Hive, Advanced SQL, and Linux. The consultant will be responsible for development, debugging, troubleshooting, and supporting daily sprint activities in a Big Data environment.

Key Responsibilities

- Develop, debug, and optimize Python and PySpark scripts.
- Write and troubleshoot complex SQL queries and Hive scripts.
- Support ETL pipelines and large-scale data processing.
- Troubleshoot production issues, logs, and performance bottlenecks.
- Work with Linux/Unix environments and shell scripting.
- Handle sprint tickets, defect resolution, and technical support.
- Leverage AI development tools such as Cursor, Claude, and GitHub Copilot.

Required Technical Skills

- Python: Strong programming, scripting, and debugging.
- Apache Spark / PySpark: Distributed data processing and optimization.
- Apache Hive: HiveQL, data transformations, and troubleshooting.
- Advanced SQL: Complex joins, CTEs, window functions,



and query tuning.
- Linux/Unix: Shell scripting, command-line operations, and log analysis.
- Big Data: HDFS, ETL pipelines, and distributed computing.
- AI Tools: Familiarity with Cursor, Claude, or GitHub Copilot.

Mandatory Requirements

- 4–8 years of relevant Big Data Engineering experience.
- Strong hands-on experience with Python, PySpark, Hive, SQL, and Linux.
- Ability to independently troubleshoot and resolve technical issues.
- Experience supporting agile sprint activities and production environments.
- Good communication and problem-solving skills.
- Reliable internet connection and remote working setup.

Ideal Candidate: Big Data Engineer / PySpark Developer / Python Data Engineer with strong development and production support experience.

Pay: ₹30,000.00 - ₹40,000.00 per month

Education:

- Bachelor's (Required)

Experience:

- Big data: 8 years (Required)

Shift availability:

- Night Shift (Required)
- Overnight Shift (Required)

Work Location: Remote

📌 Big Data & Python Support Consultant (India)
🏢 Terminus Technologies
📍 India