Role: Senior Big Data Engineer
Position Type: Full time Contract (40hrs/week)
Contract Duration: 6+ months
Work Schedule: 8 hours/day (Mon-Fri)
Location: Hybrid 2x days onsite (Wed/Thur) - Hyderabad, India Job Description

We are seeking an experienced Senior Big Data Engineer with 7+ years of expertise in designing, developing, and supporting large-scale data processing applications on AWS Cloud. The ideal candidate will have strong hands-on experience with Big Data technologies, distributed computing frameworks, cloud-native microservices, batch processing, and CI/CD automation. This role will be responsible for building scalable data platforms, optimizing high-volume batch workloads, and developing API-driven data solutions that support critical business initiatives.

Key Responsibilities
- Design, develop, implement, and maintain scalable Big Data applications and data processing pipelines on AWS Cloud.
- Build and support both API-based microservices and batch processing solutions using Java, Scala, Kotlin, and Python.




- Develop and optimize large-scale distributed data processing applications utilizing:
- Apache Spark
- Hadoop Ecosystem
- HDFS
- MapReduce
- Cassandra
- Create and maintain RESTful APIs and SOAP Web Services for enterprise data integration.
- Develop cloud-native solutions leveraging AWS services including:
- EMR
- EC2
- ECS
- S3
- Airflow
- AWS Step Functions
- AWS API Gateway
- Perform performance tuning and optimization of Spark, Hadoop, EMR, Java, and Python-based applications.
- Develop Linux-based automation scripts using Shell Scripting and Python.
- Collaborate with cross-functional teams including Data Engineering, Architecture, DevOps, and Product teams.
- Implement and maintain CI/CD pipelines to automate application deployment and infrastructure provisioning.
- Participate in code reviews, troubleshoot production issues, and ensure adherence to engineering best practices.

Required Qualifications Experience
- 7+ years of experience i

📌 Senior Big Data Engineer (Hyderabad)
🏢 Sky Systems
📍 Hyderabad