13 Nov
|
Zorba consulting
|
Hyderabad
13 Nov
Zorba consulting
Hyderabad
We are looking for an experienced Big Data Applications Engineer with robust software development skills and hands-on experience in AWS, distributed data processing, and API development.
Key Responsibilities
- Design, develop, test, and deploy scalable Big Data applications using Java, Scala, Python, and Spark.
- Build and maintain distributed batch-processing applications using Hadoop, HDFS, Spark, and MapReduce.
- Integrate new data sources and tools into existing Big Data ecosystems.
- Develop and support REST APIs, SOAP web services, microservices, and API integrations.
- Design and implement scalable data-processing solutions using AWS services.
- Optimize batch application performance across Spark, Hadoop, EMR, Java, and Python workloads.
- Work with cross-functional teams to design, develop, and deploy reliable data solutions.
- Collaborate with onsite and offshore teams, providing technical guidance on architecture and development.
- Follow secure development practices, automated testing, and CI/CD processes.
Mandatory Technical Skills
- Programming: Java, Scala, Python
- Big Data: Apache Spark, Hadoop, HDFS, MapReduce, Cassandra
- AWS: EMR,
EC2, ECS, S3, Airflow, Step Functions, API Gateway
- API Development: REST APIs, SOAP Web Services, Microservices
- Scripting: Linux, Shell Scripting, Python
- Performance Tuning: Spark, Hadoop, EMR, Java, and Python batch applications
Preferred Skills
- Git, GitHub, Bitbucket, GitLab
- Maven, Gradle, Jenkins, Artifactory
- AWS CodeCommit and CloudFormation
- IntelliJ IDEA / PyCharm
- CI/CD and automated deployment practices
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Role: Data Engineer, Industry Type: Emerging Technologies, Department: Engineering - Software & QA, Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills LinuxShell scriptingPythonPerformance tuningMavenGITData processingcassandraSCALAgithub
📌 Big Data Applications Engineer_AWS (Hyderabad)
🏢 Zorba consulting
📍 Hyderabad