29 Oct
|
EXL Service
|
Pune
Job Description: Job Title: Data Engineer (5+ Years Experience)
Job Summary
Key Responsibilities
- Develop and maintain data pipelines using PySpark and Python, Hive, Oozie
- Write efficient SQL queries for data extraction, transformation, and validation
- Assist in integrating data from multiple sources and ensuring data accuracy
- Support debugging, monitoring, and optimization of data pipelines
- Collaborate with team members to understand data requirements and deliver solutions
- Follow best practices for data engineering and documentation
Required Skills (Primary)
- 5+ years of hands-on experience in PySpark , SQL , and Python :
- 5+ years of hands-on experience in Big Data Tools like Hive ,Oozie :
- Working knowledge of cloud environments (preferably AWS )
- Understanding of data processing and ETL concepts
Secondary Skills
- Basic experience with Databricks :
- Familiarity with Linux/Unix commands for working on edge nodes
- Exposure to scheduling or orchestration tools
Good to Have
- Basic understanding of finance domain :
- Exposure to Hive and Oozie :
- Understanding of data warehousing concepts
- DBT, DAGSTER
Qualifications
- Bachelor's degree in computer science, Engineering, or related field
- 5+ years of relevant experience in data engineering or big data technologies
Soft Skills
- Valuable analytical and problem-solving skills
- Effective communication and teamwork abilities
- Willingness to learn and adapt in a fast-paced environment
- Responsibilities: Develop and maintain data pipelines using PySpark and Python, Hive, Oozie
- Write efficient SQL queries for data extraction, transformation, and validation
- Assist in integrating data from multiple sources and ensuring data accuracy
- Support debugging, monitoring, and optimization of data pipelines
- Collaborate with team members to understand data requirements and deliver solutions
- Follow best practices for data engineering and documentation
Qualifications: Graduate in Computer Science, Data Science, or related field. 5+ years of experience in data engineering or related field.
📌 Assistant Manager (Pune)
🏢 EXL Service
📍 Pune