06 Sep
|
Prodapt
|
Chennai
Overview:
ata Lake Architect to stabilize and enhance an existing AWS (Athena) + Snowflake telco data lake, owning end-to-end design improvements across schemas, ontology, and pipeline standards.
Responsibilities:
- Own stabilization and enhancement of the existing AWS (Athena) + Snowflake telco data lake.- Run discovery/working calls with the incumbent data lake team; drive technical conversations and decisions.- Diagnose and fix current issues: broken pipelines, data quality gaps, performance bottlenecks, and model inconsistencies.- Define and govern ontology/business definitions, canonical entities, and naming/metadata standards.- Design/optimize schemas (Athena tables, partitions, file formats) and Snowflake data models for analytics consumption.- Establish pipeline patterns/standards (ingestion, transformation, orchestration, monitoring, retries, rollback).- Implement data governance controls (catalog/lineage, access patterns,
PII handling, auditability).- Improve observability: logging, dashboards, SLAs, and incident triage runbooks.- Align stakeholders on target-state architecture, roadmap, and prioritized backlog of fixes/enhancements.
Requirements:
- Robust hands-on AWS data lake experience: S3, Athena, Glue (Crawlers/ETL), Lambda, IAM, CloudWatch.- Solid Snowflake knowledge: modeling, performance tuning, loading patterns, and cost-aware design.- Advanced SQL skills (Athena/Snowflake); able to debug and optimize complex queries.- Experience with PostgreSQL (schema design, querying, data extraction/CDC patterns) for source integration.- Proven ability to troubleshoot production pipelines/data issues and drive design discussions with existing teams.
📌 Lcpr data lake architect (Chennai)
🏢 Prodapt
📍 Chennai