Description

-

Key Responsibilities

-
- Assess existing SQL Server (Atlas) and Snowflake environments to identify pipeline gaps, data quality issues, and structural inefficiencies

-
- Build and maintain data pipelines supporting the Operational Data Store (ODS), including ingestion, transformation, and loading of key business entities

-
- Implement, version-control, and enforce data dictionary standards, logical/physical entity models, and naming conventions established by the Data Architect

-
- Design, implement, and maintain CI/CD pipelines (e.g., GitHub Actions, GitLab CI) to automate the deployment of Snowflake schemas, database structures, and pipeline code

-
- Manage database schema migrations as code using tools such as dbt, Schemachange, Flyway, or Terraform

-
- Execute the batch-to-API migration roadmap — re-engineering Informatica/EDW batch flows to consume FDR APIs

-
- Implement automated data quality frameworks, testing validations (e.g., dbt tests, Great Expectations), and data parity reconciliation routines between legacy and recent ODS environments

-




- Collaborate with domain teams to engineer pipelines for customer, loan, payment, and interaction data entities

-
- Apply Snowflake best practices in structuring schemas, managing compute, and separating analytical from operational workloads

-
- Partner with the internal data architect and downstream consumers to ensure data accuracy, lineage, and observability across the platform

-
- Leverage generative AI tools (e.g., coding assistants, LLMs) to accelerate pipeline development, optimize query performance, write documentation, and generate automated tests

-

Must-Have Skills

-
- 7+ years in data engineering roles with a strong focus on pipeline development, CI/CD setup, and database modeling

-
- Strong programming skills in SQL (Sql Server and Postgres) and Python for data engineering, automation, and pipeline development

-
- Proficiency in Snowflake — including schema design, performance t

📌 Senior Data Engineer | Offshore (India)
🏢 Photon Group
📍 India