19 Aug
|
institutional shareholder services
|
Gurugram
19 Aug
institutional shareholder services
Gurugram
Let’s be #BrilliantTogether
Overview:
We are looking for a Senior Data Engineer to join our Index Engineering team in Gurgaon. You will be part of a team that builds and evolves critical data platforms on a up-to-date cloud-native stack using dbt, BigQuery, and Apache Airflow on Google Cloud Platform. You will work with large-scale financial datasets, including securities master data, corporate actions, and market data from external vendors — designing robust ELT pipelines, improving data models, and driving platform enhancements using up-to-date engineering practices. This is a hands-on role for someone with robust data engineering fundamentals — someone who understands how to design scalable pipelines, model data effectively, and build reliable systems that serve business-critical workloads.
Responsibilities:
Data Modelling & Transformation- Develop and maintain data transformation logic using dbt on BigQuery — leveraging models, macros, incremental strategies, and tests to keep transformations modular, version-controlled, and well-documented.
Define and enforce naming conventions, modelling standards, and layering practices (staging, intermediate, marts) across the data warehouse.
_
Data Pipeline Engineering_
Design, build, and maintain ELT pipelines that ingest, transform, validate, and serve financial data at scale — with a focus on reliability, idempotency, and observability.
Build ingestion frameworks for external data vendor feeds — handling diverse file formats, schema variations, validation rules, reconciliation, and error recovery.
Orchestrate pipeline workflows using Apache Airflow (Cloud Composer), managing dependencies, retries, SLAs, and alerting.
Design and implement full
and incremental-load strategies, backfill mechanisms, and pipeline-recovery patterns.
_
Data Quality & Reconciliation_
Implement data reconciliation processes to verify accuracy across upstream sources and internal datasets — building automated checks for row counts
📌 Senior Data Engineer Gurugram
🏢 institutional shareholder services
📍 Gurugram