We are looking for Data Engineers with hands-on experience in building and managing scalable data pipelines using PySpark, Hive, SQL and Apache Oozie. The role involves developing reliable data solutions, optimizing performance and supporting production data platforms.
Roles & Responsibilities
- Design, develop and maintain batch data pipelines using PySpark, Hive, SQL and Oozie.
- Build reusable ETL/ELT workflows for data ingestion and transformation.
- Optimize Spark jobs, SQL queries and data processing performance.
- Implement data quality, validation, security and governance practices.
- Manage workflow scheduling, monitoring and production troubleshooting.
- Collaborate with architects, business teams and engineering stakeholders.
- Maintain technical documentation and support CI/CD deployments.
- Senior engineers will lead design reviews,
code reviews and mentor team members.
Mandatory Skills
- Python, PySpark, Apache Oozie
- Apache Hive / HiveQL, SQL
- Distributed Data Platforms
- Data Engineering and ETL/ELT
- Data Modeling and Data Warehousing
- Spark Performance Tuning
- Data Quality and Data Governance
- Workflow Scheduling and Monitoring
- Git and CI/CD
Valuable-to-Have Skills
- Cloudera Data Platform (CDP)
- Data Lakes and Data Lineage
- Banking / Financial Services Domain
- GitOps and Production Support
- Claude Code / GitHub Copilot
Experience
- Data Engineer: 3+ years
- Senior Data Engineer: 6+ years
Strong analytical, problem-solving, communication and collaboration skills are essential.
📌 Senior Data Engineer (Chennai)
🏢 ValueLabs
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.