Job Summary

Role: Data Engineer Location: Chennai / Bangalore / Hyderabad Job Summary We are seeking a highly skilled Data Engineer to join our Credit Platform team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions that support critical credit risk, lending, and decisioning capabilities. The role requires strong expertise in Python, Java, DBT and Digital Technologies (DT), along with experience in modern data engineering practices, cloud-based platforms, and enterprise-scale data products. The successful candidate will work closely with business stakeholders, architects, product owners, and engineering teams to deliver reliable, secure, and high-performance data solutions. Key Responsibilities Design, develop, test, deploy, and maintain scalable data pipelines and data products. Build and optimise ETL/ELT solutions using Python and Java. Develop robust and reusable frameworks for data ingestion, transformation, and processing. Design and implement data models, schemas, and integration patterns. Collaborate with business and technology stakeholders to understand requirements and deliver solutions. Implement data quality, validation, monitoring, and reconciliation processes. Support end-to-end software development lifecycle activities, including design, coding, testing, deployment, and production support. Drive CI/CD adoption and engineering best practices across the team. Troubleshoot and resolve production issues, perform root cause analysis, and implement preventive measures. Ensure compliance with security, governance, regulatory, and data management standards. Produce technical documentation, design artefacts, and operational runbooks. Participate in Agile ceremonies including sprint planning, stand-ups, backlog refinement, and retrospectives. Support knowledge sharing, mentoring, and continuous improvement initiatives. Mandatory Skills Technical Skills Strong hands-on experience in Python development. Hands-on experience in Java development.



Solid experience in DBT (Data Build Tool) for developing, testing, and managing scalable ELT data transformation pipelines, including data modeling, documentation, lineage tracking, and implementation of data quality checks within modern cloud data platforms. Experience building enterprise-scale data pipelines and data processing solutions. Strong SQL programming and database development expertise. Experience with data modelling, data warehousing, and data integration concepts. Knowledge of ETL/ELT frameworks and best practices. Experience with RESTful APIs and microservices-based architectures. Strong understanding of object-oriented programming and design patterns. Experience with source control tools such as Git. Working knowledge of CI/CD pipelines and DevOps practices. Experience working on cloud-based data platforms. Understanding of data governance, security, metadata management, and data quality frameworks. Professional Skills Strong analytical and problem-solving abilities. Excellent verbal and written communication skills. Ability to collaborate effectively across cross-functional teams. Experience working in Agile delivery environments. Strong stakeholder management and engagement skills. Self-driven mindset with a focus on ownership and continuous improvement. Good to Have / Additional Experience Experience with Google Cloud Platform (GCP) services such as BigQuery, Cloud Composer, Dataflow, Pub/Sub, and Cloud Storage. Experience with dbt, Terraform, and Infrastructure as Code. Knowledge of Apache Kafka or other real-time streaming technologies. Experience working within Credit Risk, Banking,



or Financial Services domains. Exposure to data observability and monitoring tools. Experience with containerisation technologies such as Docker and Kubernetes. Knowledge of Data Mesh and Data Product concepts. Familiarity with machine learning data pipelines and analytics platforms. Experience mentoring junior engineers and c

Key Responsibilities

Skill Area

Key Competencies / Tools

Priority

Hands-on Experience Required

Min. Expected Level (1-5)

Python

Modular code, pandas, packaging, PyTest, API and BigQuery client libraries

Must Have

Yes – Mandatory

4

DBT

Models, incremental strategies, macros, sources, snapshots, tests, docs, lineage

Must Have

Yes – Mandatory

4

BigQuery

Advanced SQL, window functions, partitioning, clustering, cost and performance tuning

Must Have

Yes – Mandatory

4

GCP

Cloud Storage, Pub/Sub, IAM, Cloud Logging/Monitoring, Cloud Build

Must Have

Yes – Mandatory

3

Airflow / Cloud Composer

DAG design, operators, scheduling, retries, backfills, alerting, SLAs

Must Have

Yes – Mandatory

4

TDD

Test-first development, PyTest, DBT/data tests, DAG tests, CI integration

Must Have

Yes – Mandatory

4

Agentic Engineering

AI coding agents, prompt/context design, tool calling, evals, guardrails, review practices

Must Have

Yes – Mandatory

3

Data Modelling & Quality

Star schema, SCD, incremental loads, reconciliation, Great Expectations/Soda

Good to Have

Preferred

3

CI/CD & IaC

Git, Cloud Build/GitHub Actions/Jenkins, Terraform, Docker

Good to Have

Preferred

3

Streaming & Big Data

Dataflow (Beam), Dataproc/Spark, Pub/Sub streaming

Good to Have

Preferred

2

Agile & Communication

Scrum, stakeholder collaboration, mentoring, documentation

Must Have

Not applicable

3

Skill Requirements

Must Have Skill

Data Build Tool (DBT),GCP BigQuery,Python

Good to Have Skill

Other Requirements

📌 Senior Technical Lead (Hyderabad)
🏢 HCLTech
📍 Hyderabad