12 Aug
|
SarvaGram
|
Pune
Key Responsibilities
Data Ingestion & Pipeline Engineering
• Design and build reliable, scalable data pipelines ingesting from PostgreSQL, MySQL, MongoDB, Apache Kafka, and AWS SQS into Snowflake.
• Implement CDC (Change Data Capture) patterns for near-real-time ingestion from transactional Aurora (PostgreSQL and MySQL) databases.
• Build and maintain ELT pipelines using Python and dbt, ensuring data quality, lineage, and observability at every stage.
• Handle schema evolution gracefully across heterogeneous source systems without breaking downstream consumers.
Data Modelling & Warehouse Design
• Design dimensional models, data vault structures, or medallion architecture layers (bronze/silver/gold) in Snowflake suited to SarvaGram's lending, collections, and field operations domains.
• Own the Snowflake warehouse — clustering keys, micro-partition strategy, materialized views, energetic tables, and cost governance.
• Define and enforce data modelling standards, naming conventions, and documentation practices across all datasets.
Snowflake Administration
• Manage Snowflake account administration — user and role management, RBAC configuration, resource monitors, and virtual warehouse sizing.
• Monitor and govern Snowflake credit consumption — identify expensive queries, configure auto-suspend/auto-resume policies, and right-size virtual warehouses for different workload types.
• Maintain Snowflake security posture — network policies, data masking policies, row access policies, and column-level security for PII fields.
• Manage Snowflake storage — database, schema, and table lifecycle policies, time travel configuration, and Fail-safe awareness.
• Drive Snowflake feature adoption (e.g. dynamic tables, Snowpark) and stay current with platform capabilities relevant to SarvaGram's data stack.
Analytics Layer & Trino
• Maintain and optimise the Trino query layer over Snowflake and other data stores, ensuring performant and cost-efficient analytical queries.
📌 Senior Data Engineer (Pune)
🏢 SarvaGram
📍 Pune