Role: Mid level Big Data Engineer Position Type: Full time Contract (40hrs/week)Contract Duration: 6+ months Work Schedule: 8 hours/day (Mon-Fri)Location: Hybrid 2x days onsite (Wed/Thur) - Hyderabad, India We are seeking a Mid-Level Data Engineer with 4–6 years of experience to build and support large-scale Big Data applications and cloud-based data pipelines. The ideal candidate will have strong hands-on experience with Python, AWS EMR, Spark, SQL, and AWS cloud services, with particular expertise in EMR performance tuning and cost optimization.

Key Responsibilities Build and maintain scalable data pipelines and Big Data applications. Develop data transformation processes using Python, Spark, SQL, Hive, and related technologies. Work extensively with AWS services including EMR, EC2, Lambda, S3, Dynamo DB, and API Gateway.

Optimize AWS EMR workloads for performance and cost efficiency. Build and maintain Apache Airflow workflows and DAGs.



Troubleshoot production issues and improve data pipeline reliability. Participate in architecture reviews, code reviews, testing, and performance tuning.

Work with cross-functional Agile teams to deliver scalable data solutions.

Required

Skills4–6 years of Data Engineering or Big Data experience.

Strong

Python development experience. Hands-on AWS EMR experience — required.

Experience with EMR performance and cost optimization — required.

Strong

Spark / Py Spark experience. SQL and data transformation experience. AWS experience with EMR, EC2, Lambda, and S3.

Experience building large-scale batch data pipelines.

Apache

Airflow experience preferred. Strong troubleshooting and problem-solving skills.

📌 Data Engineer (Hyderabad)
🏢 Sky Systems
📍 Hyderabad