• Utilize strong software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions.
• Design, develop, and maintain scalable Big Data applications and distributed data processing solutions.
• Integrate new data sources, tools, and technologies into existing Big Data ecosystems.
• Implement scalable, reliable, and fault-tolerant distributed data ingestion and replication strategies.
• Work with large datasets using Apache Spark and various components of the Hadoop ecosystem.
• Collaborate with cross-functional teams to design, develop, test, and deploy data tools supporting business and product requirements.
• Provide technical guidance and mentorship to onsite/offshore developers on architecture, design, and implementation.
• Own end-to-end product features across the software development lifecycle, from development and testing to production deployment.
• Evaluate emerging Big Data technologies and develop prototypes to improve data processing architecture and performance.
• Automate data engineering workflows, testing, deployment,



and operational processes. Required Skills
• Strong hands-on experience in Java, Python, Scala, and Apache Spark.
• Experience with Big Data technologies and the Hadoop ecosystem.
• Strong understanding of data ingestion, transformation, and distributed data processing.
• Experience integrating multiple data sources and developing scalable data pipelines.
• Understanding of distributed data replication strategies.
• Solid object-oriented programming, design, and analysis skills.
• Experience with Agile/Scrum development methodologies.
• Knowledge of secure application development practices.
• Understanding of automated QA and testing requirements for Big Data applications.
• Ability to translate technical and business requirements into effective technical solutions.
• Excellent written and verbal communication skills.
• Apache Airflow experience is preferred.

Skills:
java,communication,python

📌 Big Data Engineer (Hyderabad)
🏢 Zorba AI
📍 Hyderabad