Job Description
Role: Mid level Big Data Engineer
nPosition Type: Full time Contract (40hrs/week)
nContract Duration: 6+ months
nWork Schedule: 8 hours/day (Mon-Fri)
nLocation: Hybrid 2x days onsite (Wed/Thur) - Hyderabad, India
n

nWe are seeking a Mid-Level Data Engineer with 4–6 years of experience to build and support large-scale Big Data applications and cloud-based data pipelines.
nThe ideal candidate will have strong hands-on experience with Python, AWS EMR, Spark, SQL, and AWS cloud services, with particular expertise in EMR performance tuning and cost optimization.
n

nKey Responsibilities
n
- n
- Build and maintain scalable data pipelines and Big Data applications.n
- Develop data transformation processes using Python, Spark, SQL, Hive, and related technologies.n
- Work extensively with AWS services including EMR, EC2, Lambda, S3, DynamoDB, and API Gateway.n
- Optimize AWS EMR workloads for performance and cost efficiency.n




- Build and maintain Apache Airflow workflows and DAGs.n
- Troubleshoot production issues and improve data pipeline reliability.n
- Participate in architecture reviews, code reviews, testing, and performance tuning.n
- Work with cross-functional Agile teams to deliver scalable data solutions.n

n

nRequired Skills
n
- n
- 4–6 years of Data Engineering or Big Data experience.n
- Strong Python development experience.n
- Hands-on AWS EMR experience — required.n
- Experience with EMR performance and cost optimization — required.n
- Strong Spark / PySpark experience.n
- SQL and data transformation experience.n
- AWS experience with EMR, EC2, Lambda, and S3.n
- Experience building large-scale batch data pipelines.n
- Apache Airflow experience preferred.n
- Strong troubleshooting and problem-solving skills.n

n

📌 Data Engineer (Hyderabad)
🏢 Sky Systems, Inc. (SkySys)
📍 Hyderabad