Company Name: VARITE India Private Limited

About The Client

Xebia is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.

About The Job:

- We are seeking a highly skilled and motivated Data Engineer with expertise in Python, PySpark, Hive, Hadoop HDFS, Oozie, and YARN to join our data engineering team.

- The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and systems that enable productive data processing and analytics across the organization.

Essential Job Functions:

- Design and implement robust, scalable, and efficient data pipelines using PySpark and Python.

- Work with Hadoop HDFS to manage and process large volumes of structured and unstructured data.

- Develop and optimize Hive queries for data extraction and transformation.

- Schedule and monitor workflows using Apache Oozie.

- Optimize data processing tasks to work efficiently within the YARN resource management framework.

- Collaborate with data scientists, analysts, and other engineers to ensure data availability and quality.

- Monitor data pipelines and troubleshoot issues related to performance, scalability, and reliability.

- Implement data governance and security best practices.

- Document data flow processes, schemas, and configurations.

Qualifications

- Total years : 6+ Years

Required Skills & Qualifications:

- Bachelor's or Master’s degree in Computer Science, Engineering, or related field.

- 3+ years of experience in data engineering or related roles.

- Strong programming skills in Python and PySpark.

- Hands-on experience with Apache Hive, HDFS, Oozie, and YARN.

- Solid understanding of big data ecosystem and distributed computing.

- Experience with SQL and data modeling.





- Familiarity with data pipeline tools and job orchestration frameworks.

- Strong problem-solving and debugging skills.

- Excellent communication and collaboration abilities.

Preferred Qualifications

- Experience with cloud platforms like AWS, Azure, or GCP.

- Exposure to tools like Apache Airflow, Kafka, or Spark Streaming.

- Knowledge of CI/CD processes and tools.

- Familiarity with containerization (Docker, Kubernete

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

0-2 years

INR 5,000

2-6 years

INR 7,500

6+ years

INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.

📌 Big Data Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru