21 Aug
|
Sky Systems, Inc. (SkySys)
|
Hyderabad
21 Aug
Sky Systems, Inc. (SkySys)
Hyderabad
Role:
Senior Big Data Developer
Position Type:
Full time Contract (40hrs/week)
Contract Duration:
Long Term
Work Schedule:
8 hours/day (Mon-Fri)
Location:
Hybrid 2x Days onsite - (Wed/Thurs) Hyderabad, India
We are seeking an experienced
Senior Big Data Developer
to design, develop, and support large-scale data processing applications on AWS Cloud. The ideal candidate will have strong experience building distributed data platforms using Apache Spark, Hadoop, Scala, PySpark, Java, and cloud-native AWS services.
This role focuses on developing scalable batch processing pipelines, API-driven services, and cloud-native Big Data solutions that support high-volume enterprise data processing.
Key Responsibilities
Design, develop, and maintain scalable Big Data applications and distributed data processing pipelines.
Build high-performance batch processing solutions using Apache Spark, Hadoop, and AWS.
Develop REST APIs and microservices supporting enterprise data platforms.
Build cloud-native applications utilizing AWS services including EMR, EC2, ECS, S3,
API Gateway, Step Functions, and Airflow.
Develop applications using Scala, PySpark, Java, Kotlin, and Python.
Optimize Spark, Hadoop, and distributed workloads for performance and scalability.
Develop Linux shell scripts and Python automation.
Collaborate with Data Engineering, Architecture, DevOps, and Product teams.
Build and maintain CI/CD pipelines using Jenkins and AWS DevOps tools.
Troubleshoot production issues and participate in code reviews.
Required Qualifications
7+ years of experience developing Big Data applications.
Robust experience building scalable distributed data processing platforms.
Hands-on experience with Apache Spark, Hadoop, HDFS, MapReduce, and Cassandra.
Robust programming experience with Scala, PySpark, Java, Kotlin, and Python.
Experience developing REST APIs and Microservices.
Robust experience with AWS services including EMR, EC2, ECS, S3, API Gateway
📌 Senior Big Data Developer Hyderabad
🏢 Sky Systems, Inc. (SkySys)
📍 Hyderabad