Role: Mid-level Big Data Engineer

Position Type: Full-Time Contract (40hrs/week)

Contract Duration: 6 months+

Work Schedule : 8 hours/day (Mon-Fri)

Location : Hyderabad, Hybrid(Wed and Thursday to be onsite)

We are looking for an experienced Big Data Engineer to develop, implement, test, and optimize large-scale batch and API-based applications on AWS. The ideal candidate will have strong hands-on programming experience in Scala, PySpark, and Java, along with expertise in Spark/Hadoop processing, AWS services, and Linux scripting.

Key Responsibilities

- Develop and maintain big data batch applications and API-based services on AWS.
- Build REST and SOAP web services using Scala, PySpark, Java, or related technologies.
- Work with Apache Spark, Hadoop, HDFS, MapReduce, and Cassandra.
- Develop and support AWS workloads using EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway.




- Tune and optimize batch processing performance across Spark, Hadoop, EMR, Java, and Python applications.
- Use Linux, shell scripting, and Python for automation, troubleshooting, and operational support.
- Collaborate with DevOps teams on version control, CI/CD, and deployment processes.

Requirements

- 6+ years of experience developing and testing big data applications.
- Strong Scala, PySpark, and Java programming skills.
- Hands-on AWS experience, particularly EMR and related batch-processing services.
- Experience with Spark, Hadoop/HDFS, MapReduce, and REST/SOAP services.
- Robust Linux and shell scripting skills.

Location: Hyderabad, hybrid — onsite Wednesday and Thursday.

📌 Big Data Developer (Hyderabad)
🏢 Sky Systems, Inc. (SkySys)
📍 Hyderabad