08 Oct
|
Ness Digital Engineering
|
Hyderabad
08 Oct
Ness Digital Engineering
Hyderabad
Life at Ness
At Ness, people come first. Here, you'll be part of a vibrant team that values curiosity, innovation, and growth. We work with industry-leading clients on projects that truly make an impact while supporting every team member in carving out their unique career path. With resources for learning, certifications, and hands-on experiences, Ness offers you more than just a job—it’s a place where your ideas, ambition, and well-being matter.
The Role
We are looking for a hands-on Big Data Engineer with deep experience in developing and managing large-scale data platforms. The ideal candidate will bring strong Spark, Python/Scala development skills, and solid understanding of the Hadoop ecosystem. You’ll work in Agile teams on financial, analytical, and innovation-driven data products—driving performance optimization, recent development, and platform operations.
Key Responsibilities
· Design and develop big data solutions using Apache Spark, Hadoop, and cloud-native tools
· Write efficient batch and stream processing pipelines in Python and/or Scala
· Maintain and optimize data workflows and performance across large data volumes
· Manage source control, versioning, and deployments using Git, Jenkins, and other DevOps tools
· Conduct performance tuning, system monitoring, and issue resolution
· Collaborate with architects, analysts, and business stakeholders to align technical delivery with use cases
· Work with Cloudera Hadoop and manage activities like node configuration, file system maintenance, and backups
· Follow best practices across software development, code quality, and agile ceremonies
· Contribute to code reviews, technical documentation, and mentoring junior developers
· Support and enhance production environments, including disaster recovery planning
Qualifications and Skills
Core Skills
· 6–10 years of experience in big data development and operations
· Strong programming expertise in Python and/or Scala
· Hands-on with Apache Spark, Hadoop, Cloude
📌 Bigdata team member (Hyderabad)
🏢 Ness Digital Engineering
📍 Hyderabad