Senior Data Engineer with Snowflake OpenFlow (Bengaluru)

Senior Data Engineer with Snowflake OpenFlow (Bengaluru)

15 Nov
|
Dataart Technologies
|
Bengaluru

15 Nov

Dataart Technologies

Bengaluru

Job highlights

- Hands-on experience with Snowflake OpenFlow or Apache NiFi, strong PostgreSQL/Aurora logical replication skills, Terraform on AWS, DBT, and SQL proficiency

- Configure and operate Snowflake OpenFlow, tune Aurora PostgreSQL replication, provision AWS infrastructure with Terraform, run POC tests, monitor replication health, support managed ingestion setup, apply security and governance, and perform pipeline renewals

Responsibilities

- Configure and operate Snowflake OpenFlow from Aurora PostgreSQL to Snowflake

- Tune and troubleshoot Aurora PostgreSQL for logical replication

- Provision infrastructure using Terraform and AWS IAM with least privilege access controls

- Run structured proof of concept tests for large tables high volume CDC concurrency and outage recovery scenarios

- Document outcomes of proof of concept testing and validation activities

- Monitor replication health using Snowflake native observability and Amazon CloudWatch

- Define success criteria with stakeholders for replication and ingestion validation

- Support Snowflake side setup for managed ingestion including warehouses grants schedules and reconciliation checks

- Apply security and governance practices appropriate to a regulated financial and member services context

- Perform schema DBT and Snowflake native pipeline renewal while preserving business and data continuity

- Execute performance and cost improvements

- Follow agreed teardown procedures to remove replication and access artifacts





Requirements

- Hands on experience with Snowflake OpenFlow or Apache NiFi

- Strong experience with PostgreSQL or Aurora including logical replication WAL slots and access control

- Experience with Terraform on AWS including networking security groups IAM and role pass through for managed services

- Experience with DBT for data transformations

- Proficiency in SQL for transformations validation and reconciliation

- Working knowledge of Snowflake including warehouses roles and loading patterns

- Understanding of CDC and ELT fundamentals

- Experience with data quality validation and reconciliation practices

- Robust communication skills for Agile cross team collaboration in distributed teams

- Experience with GitHub

Nice to have

- Experience with PostgreSQL sources and Snowflake targets using OpenFlow NiFi or similar services

- Experience with Python or similar languages for checks automation and reporting

- Experience with Snowflake OpenFlow or similar managed CDC offerings

- Experience with Airflow or equivalent tools for production orchestration

- Experience in financial services or similar regulated domains

- Experience with cloud cost estimation for replication at scale

- Experience with Amazon EKS or Kubernetes for monitoring and issue resolution in the OpenFlow or NiFi environment

- Experience with Cursor or Claude

- Experience with specification driven development

Apply for the job

📌 Senior Data Engineer with Snowflake OpenFlow (Bengaluru)
🏢 Dataart Technologies
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer with snowflake openflow (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer with snowflake openflow (bengaluru) / bengaluru