30 Aug
|
Sky Systems, Inc. (SkySys)
|
Hyderabad
30 Aug
Sky Systems, Inc. (SkySys)
Hyderabad
Role: Mid level Big Data EngineerPosition Type: Full-Time Contract (40hrs/week)Contract Duration: 6+ monthsWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid 2x days onsite (Wed/Thur) - Hyderabad, IndiaWe are seeking a Mid-Level Data Engineer with 4–6 years of experience to build and support large-scale Big Data applications and cloud-based data pipelines.The ideal candidate will have strong hands-on experience with Python, AWS EMR, Spark, SQL, and AWS cloud services, with particular expertise in EMR performance tuning and cost optimization.Key ResponsibilitiesBuild and maintain scalable data pipelines and Big Data applications.Develop data transformation processes using Python, Spark, SQL, Hive, and related technologies.Work extensively with AWS services including EMR, EC2, Lambda, S3, DynamoDB,
and API Gateway.Optimize AWS EMR workloads for performance and cost efficiency.Build and maintain Apache Airflow workflows and DAGs.Troubleshoot production issues and improve data pipeline reliability.Participate in architecture reviews, code reviews, testing, and performance tuning.Work with cross-functional Agile teams to deliver scalable data solutions.Required Skills4–6 years of Data Engineering or Big Data experience.Strong Python development experience.Hands-on AWS EMR experience — required.Experience with EMR performance and cost optimization — required.Solid Spark / PySpark experience.SQL and data transformation experience.AWS experience with EMR, EC2, Lambda, and S3.Experience building large-scale batch data pipelines.Apache Airflow experience preferred.Strong troubleshooting and problem-solving skills.
📌 Data Engineer (Hyderabad)
🏢 Sky Systems, Inc. (SkySys)
📍 Hyderabad