18 Aug
|
institutional shareholder services
|
Gurugram
18 Aug
institutional shareholder services
Gurugram
Let’s be #BrilliantTogether
Overview:
We are looking for a Senior Data Engineer to join our Index Engineering team in Gurgaon. You will be part of a team that builds and evolves critical data platforms on a modern cloud-native stack using dbt, BigQuery, and Apache Airflow on Google Cloud Platform. You will work with large-scale financial datasets, including securities master data, corporate actions, and market data from external vendors — designing robust ELT pipelines, improving data models, and driving platform enhancements using modern engineering practices. This is a hands-on role for someone with robust data engineering fundamentals — someone who understands how to design scalable pipelines, model data effectively, and build reliable systems that serve business-critical workloads.
Responsibilities:
_ Data Modelling & Transformation_- Develop and maintain data transformation logic using dbt on BigQuery — leveraging models, macros, incremental strategies, and tests to keep transformations modular, version-controlled, and well-documented.
- Define and enforce naming conventions,
modelling standards, and layering practices (staging, intermediate, marts) across the data warehouse.
_
- Data Pipeline Engineering_
- Design, build, and maintain ELT pipelines that ingest, transform, validate, and serve financial data at scale — with a focus on reliability, idempotency, and observability.
- Build ingestion frameworks for external data vendor feeds — handling diverse file formats, schema variations, validation rules, reconciliation, and error recovery.
- Orchestrate pipeline workflows using Apache Airflow (Cloud Composer), managing dependencies, retries, SLAs, and alerting.
- Design and implement full
- and incremental-load strategies, backfill mechanisms, and pipeline-recovery patterns.
_
- Data Quality & Reconciliation_
- Implement data reconciliation processes to verify accuracy across upstream sources and internal datasets — building automated checks for row counts
📌 Senior Data Engineer (Gurugram)
🏢 institutional shareholder services
📍 Gurugram