Big Data Applications Engineer (Hyderabad)

Big Data Applications Engineer (Hyderabad)

18 Nov
|
Zorba AI
|
Hyderabad

18 Nov

Zorba AI

Hyderabad

We are looking for an experienced Big Data Applications Engineer with strong software development skills in Java, Scala and Python, along with hands-on experience in Apache Spark, Hadoop and AWS services. The ideal candidate should have experience developing scalable Big Data applications, building REST/SOAP APIs and microservices, processing large-scale batch workloads, and optimizing distributed applications on AWS.

Key Responsibilities
Design, develop and maintain scalable Big Data applications using Java, Scala, Python and PySpark. Develop and optimize distributed data processing applications using Apache Spark, Hadoop, HDFS and MapReduce. Build and integrate REST APIs, SOAP web services and microservices. Develop and deploy applications using AWS services such as EMR, EC2, ECS, S3 and API Gateway. Implement workflow orchestration using Apache Airflow and AWS Step Functions. Perform batch application performance tuning and optimization across Spark, Hadoop, Java and Python workloads. Work with distributed data technologies such as Cassandra and other NoSQL databases. Develop Linux shell scripts and Python automation utilities. Follow software engineering best practices, including version control, code reviews, build automation and CI/CD. Mandatory Technical Skills Strong hands-on programming experience in Java and/or Scala, with Python/PySpark. Strong experience in Apache Spark, Spark SQL and Hadoop ecosystem.



Good understanding of HDFS, MapReduce and distributed computing. Hands-on experience with AWS services: EMR, EC2, ECS and S3. Experience developing REST APIs / SOAP web services and microservices. Knowledge of AWS API Gateway and AWS Step Functions. Experience in batch processing and performance optimization. Valuable knowledge of Linux/Unix and Shell scripting. Preferred Skills Apache Airflow Cassandra / NoSQL databases Git, GitHub, GitLab or Bitbucket Maven / Gradle Jenkins and CI/CD pipelines AWS CodeCommit and CloudFormation Artifactory IntelliJ IDEA / PyCharm Ideal Candidate Profile 6–12 years of relevant software engineering / Big Data development experience. Strong application development background rather than only ETL pipeline development. Experience writing production-quality Java/Scala code. Hands-on AWS Big Data application development and deployment experience. Good problem-solving, debugging and performance-tuning skills. Ability to develop and maintain scalable, reliable distributed applications. Keywords: Big Data Engineer, Big Data Developer, Java Developer, Scala Developer, Apache Spark, PySpark, Hadoop, HDFS, MapReduce, AWS EMR, AWS EC2, S3, ECS, REST API, SOAP, Microservices, API Gateway, Airflow, Step Functions.

Skills:
linux,hadoop,microservices,aws,python,ci/cd,hdfs,sql,java,ec2,emr

📌 Big Data Applications Engineer (Hyderabad)
🏢 Zorba AI
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: big data applications engineer (hyderabad) / hyderabad

Subscribe to this job alert:

Get the latest job offers by email for: big data applications engineer (hyderabad) / hyderabad