Senior Data Engineer (Client: Kastle System) [Remote. Strong Snowflake experience is a must-have; other details are provided below.]

Location: Remote

Note: Solid Snowflake experience is a must-have; other details are provided below.

Key Responsibilities:

Build and operate production-grade batch and streaming data pipelines across SQL Server, cloud applications, device/event streams, Customer Relationship Management systems, and third-party sources.

Develop ingestion, transformation, and enrichment pipelines using Apache Flink, Kafka, Change Data Capture, SQL, and Python/Java/Scala.

Implement lakehouse data layers across landing, raw, conformed, and consumption zones using Apache Iceberg and Trino.

Build dimensional and analytical models for entities such as buildings, tenants, credentials, devices, and people.

Implement robust handling for Change Data Capture, late-arriving data, retries, backfills, replay, schema evolution, and data reconciliation.

Build and maintain integration between the lakehouse and Snowflake, including Iceberg-backed/external tables,



secure sharing, and downstream data contracts.

Develop automated data-quality checks, pipeline monitoring, lineage, freshness alerts, and operational dashboards.

Troubleshoot and resolve production data issues, pipeline failures, performance bottlenecks, and data-quality problems.

Optimize SQL queries, storage layouts, partitioning, clustering, compute utilization, and overall platform cost.

Implement security controls including role-based access, row/column-level security, masking, and protection of sensitive data.

Build and maintain Continuous Integration and Continuous Deployment pipelines, automated testing, infrastructure-as-code, and environment promotion processes.

Participate in production support, incident resolution, Root Cause Analysis, deployment, and on-call activities.

Work closely with Product, Application Engineering, Quality Assurance, DevOps/Site Reliability Engineering, Analyti

📌 Sr Data Engineer (India)
🏢 Highbrow Technologies
📍 India