30 Oct
|
Sky Systems, Inc. (SkySys)
|
Secunderabad
30 Oct
Sky Systems, Inc. (SkySys)
Secunderabad
Role: Mid-level Big Data Engineer Position Type: Full time Contract (40hrs/week)
Contract Duration: 6 months+
Work Schedule : 8 hours/day (Mon-Fri)
Location : Hyderabad, Hybrid(Wed and Thursday to be onsite)
We are looking for an experienced Big Data Engineer to develop, implement, test, and optimize large-scale batch and API-based applications on AWS. The ideal candidate will have strong hands-on programming experience in Scala, PySpark, and Java, along with expertise in Spark/Hadoop processing, AWS services, and Linux scripting.
Key Responsibilities
Develop and maintain big data batch applications and API-based services on AWS.
Build REST and SOAP web services using Scala, PySpark, Java, or related technologies.
Work with Apache Spark, Hadoop, HDFS, MapReduce, and Cassandra.
Develop and support AWS workloads using EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway.
Tune and optimize batch processing performance across Spark, Hadoop, EMR, Java, and Python applications.
Use Linux, shell scripting, and Python for automation, troubleshooting, and operational support.
Collaborate with DevOps teams on version control, CI/CD, and deployment processes.
Requirements
- 6+ years of experience developing and testing big data applications.
- Strong Scala, PySpark, and Java programming skills.
- Hands-on AWS experience, particularly EMR and related batch-processing services.
- Experience with Spark, Hadoop/HDFS, MapReduce, and REST/SOAP services.
- Strong Linux and shell scripting skills.
Location: Hyderabad, hybrid — onsite Wednesday and Thursday.
📌 Big Data Engineer (Hybrid) (Secunderabad)
🏢 Sky Systems, Inc. (SkySys)
📍 Secunderabad