16 Nov
|
HCLTech
|
Bengaluru
Job Summary
- Senior Data Engineers experienced in Hadoop/Teradata
- Also share some senior profiles for DAP/EDP (Dbt, Snowflake, AWS) would be great
Key Responsibilities
- Build pipelines consuming Cards data from commbank.data.
- Develop Snowflake models and transformations.
- Build production PySpark processing.
- Map HPS card/account data into Collections structures.
- Build data interfaces required by PCC.
- Implement data-quality and reconciliation controls.
- Handle late, missing, duplicated and corrected data.
- Build restartable and recoverable processing.
- Implement monitoring and alerting.
- Optimise Snowflake SQL and PySpark workloads.
- Support migration rehearsals and parallel runs.
- Investigate production data defects.
- Participate in design and code reviews
Skill Requirements
- - Snowflake.
- PySpark.
- Python.
- Advanced SQL.
- AWS and S3.
- Data pipelines and ETL/ELT.
- Data modelling.
- Data quality and reconciliation.
- Git and CI/CD.
- Production troubleshooting.
- Hadoop
- Teradata
Must Have Skill
Amazon Web Services (AWS),Data Build Tool (DBT),Data Modelling,Hadoop,Snowflake,Teradata
Positive to Have Skill
Other Requirements
- EMR / EMR Serverless.
- Step Functions or Lambda.
- Banking experience.
📌 Senior Technical Lead (Bengaluru)
🏢 HCLTech
📍 Bengaluru