25 Oct
|
Lloyds Technology Centre
|
Hyderabad
25 Oct
Lloyds Technology Centre
Hyderabad
Job Description Summary
Role Title: Data Engineer
Location: Hyderabad
Role Type: Hybrid
Role Overview
We are seeking a Data Engineer to join our Corporate Institutional Banking (CIB) business. The role will design, build and support trusted cloud data products and scalable data pipelines for Trade Finance, Finance, Risk, customer experience, reporting and analytics use cases.
Job Description
Key Responsibilities
- Design, develop and maintain reusable data products, ingestion pipelines and transformation frameworks on Google Cloud Platform.
- Develop and optimise SQL, Python, PySpark and dbt transformations supporting batch and large-scale data processing.
- Build and operate orchestration workflows using Cloud Composer / Apache Airflow and processing solutions using BigQuery, Dataproc and Cloud Storage.
- Implement data-quality controls covering schema validation, completeness, duplication, reconciliation, business-date alignment and exception handling.
- Apply engineering standards through version control, peer review, unit testing, automated deployment and CI/CD practices.
- Monitor production pipelines, investigate failures and improve reliability, performance, recovery and operational support.
- Work with Product Owners, Business Analysts, Data Modelers,
Architects, BI colleagues and Quality Engineers to deliver end-to-end outcomes.
- Produce clear technical designs, data lineage, runbooks and support documentation.
What Youll Need
- Strong hands-on experience with GCP, BigQuery, Cloud Storage, Dataproc and Cloud Composer / Apache Airflow.
- Advanced SQL and practical experience with Python, PySpark and dbt.
- Experience building scalable ETL / ELT pipelines, reusable data products and governed data layers.
- Knowledge of Git, CI/CD, automated testing, infrastructure-as-code and Terraform.
- Understanding of data warehousing, dimensional models, metadata, lineage and data-quality controls.
- Experience with performance tuning, monitoring, incident investigation and production support.
- Knowledge of secure cloud engineering, access controls, encryption and regulated-data handling.
- Robust analytical, documentation and stakeholder communication skills.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer (Hyderabad)
🏢 Lloyds Technology Centre
📍 Hyderabad