09 Sep
|
Peak Finder Consulting Chennai
|
Chennai
09 Sep
Peak Finder Consulting Chennai
Chennai
Key Responsibilities
Design, build, and optimize ELT/ETL pipelines using AWS (Glue, Lambda, S3) and Snowflake.
Develop Snowflake data models, including staging, integration, and Gold-layer transformations.
Create and maintain Snowflake tasks, streams, stored procedures, and pipe-based ingestion.
Implement data pipeline monitoring, alerting, logging, and auto-recovery mechanisms.
Tune Snowflake performance through warehouse sizing, caching, clustering, and query optimization.
Build secure ingestion paths using IAM roles, policies, AWS Secrets Manager, VPC endpoints, etc.
Collaborate with BI, architecture, and product teams to ensure data availability and quality.
Develop data quality rules and validation suites for pipeline integrity.
Document architecture, lineage, mapping, and transformation logic.
📌 Data Engineer Chennai
🏢 Peak Finder Consulting Chennai
📍 Chennai