Company Name: VARITE India Private Limited

About The Client:

Xebia is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.

About The Job:
- We are seeking a highly skilled and motivated Data Engineer with expertise in Python, PySpark, Hive, Hadoop HDFS, Oozie, and YARN to join our data engineering team.
- The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and systems that enable efficient data processing and analytics across the organization.

Essential Job Functions:
- Design and implement robust, scalable, and efficient data pipelines using PySpark and Python.
- Work with Hadoop HDFS to manage and process large volumes of structured and unstructured data.
- Develop and optimize Hive queries for data extraction and transformation.
- Schedule and monitor workflows using Apache Oozie.




- Optimize data processing tasks to work efficiently within the YARN resource management framework.
- Collaborate with data scientists, analysts, and other engineers to ensure data availability and quality.
- Monitor data pipelines and troubleshoot issues related to performance, scalability, and reliability.
- Implement data governance and security best practices.
- Document data flow processes, schemas, and configurations.

Qualifications:
- Total years : 6+ Years

Required Skills & Qualifications:
- Bachelor's or Master’s degree in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering or related roles.
- Strong programming skills in Python and PySpark.
- Hands-on experience with Apache Hive, HDFS, Oozie, and YARN.
- Solid understanding of big data ecosystem and distributed computing.
- Experience with SQL and data modeling.
- Familiarity with data pipeline tools and job orchestration frameworks.
- Robust problem-solving and debuggi

📌 Big Data Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru