We are looking for Data Engineers with hands-on experience in building and managing scalable data pipelines using PySpark, Hive, SQL and Apache Oozie. The role involves developing reliable data solutions, optimizing performance and supporting production data platforms.
Roles & Responsibilities
Design, develop and maintain batch data pipelines using PySpark, Hive, SQL and Oozie.
Build reusable ETL/ELT workflows for data ingestion and transformation.
Optimize Spark jobs, SQL queries and data processing performance.
Implement data quality, validation, security and governance practices.
Manage workflow scheduling, monitoring and production troubleshooting.
Collaborate with architects, business teams and engineering stakeholders.
Maintain technical documentation and support CI/CD deployments.
Senior engineers will lead design reviews,
code reviews and mentor team members.
Mandatory Skills
Python, PySpark, Apache Oozie
Apache Hive / HiveQL, SQL
Distributed Data Platforms
Data Engineering and ETL/ELT
Data Modeling and Data Warehousing
Spark Performance Tuning
Data Quality and Data Governance
Workflow Scheduling and Monitoring
Git and CI/CD
Valuable-to-Have Skills
Cloudera Data Platform (CDP)
Data Lakes and Data Lineage
Banking / Financial Services Domain
GitOps and Production Support
Claude Code / GitHub Copilot
Experience
Data Engineer: 3+ years
Senior Data Engineer: 6+ years
Robust analytical, problem-solving, communication and collaboration skills are essential.
📌 Senior Data Engineer Chennai (India)
🏢 ValueLabs
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.