06 Aug
|
eClerx
|
Bengaluru
Job Title: Senior Data Engineer Big Data (Hadoop, PySpark, SQL)
Required Skills & Experience
- 5+ years of experience in Data Engineering, ETL, or Data Warehousing.
- Strong proficiency in Python, PySpark, and SQL.
- Hands-on experience with Hadoop ecosystem, including Hive and HDFS.
- Experience building and maintaining large-scale data pipelines.
- Solid understanding of structured and unstructured data processing.
- Experience working with Oracle, SQL Server, PostgreSQL, MongoDB, and Hive.
- Experience handling large volumes of enterprise data.
- Strong knowledge of data governance principles and coding best practices.
- Experience in requirements gathering, testing, and production support.
- Excellent analytical, communication, and problem-solving skills.
- Ability to work independently, take ownership, and deliver within project timelines.
Preferred Qualifications
- Experience with Hue Client and Hadoop ecosystem administration.
- Experience with cloud platforms (AWS, Azure, or GCP).
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with Indexima or similar indexing technologies.
- Experience with Data Cataloging solutions.
- Knowledge of Ranger Policies and enterprise data governance frameworks.
📌 Big Data Engineer (Bengaluru)
🏢 eClerx
📍 Bengaluru