04 Sep
|
Tata Consultancy Services
|
Kolkata
04 Sep
Tata Consultancy Services
Kolkata
Job Title: Data Architect
Exp Range: 12 - 18
Job Location: Kolkata Only
Required skill: Databricks, AWS ,RedshiftEDW DB to Databricks Lakehouse Platform on AWS
12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS
- 12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS
- Should have experience of migration of an enterprise data warehouse from AWS Redshift/RDS or any other EDW DB to Databricks Lakehouse Platform on AWS. Conversant with cloud-native architectures, Databricks platform capabilities and contemporary data Lakehouse design patters. Can able to own end-to-end architecture, including migration strategy, data modeling, governance and performance optimization.
- Key Responsibilities:
a) Architecture & Strategy: Define target architecture, conduct gap analysis, design data Ingestion, storage,
transformation and consumption layer using delta lake along with Databricks best practices b) Data Modeling & Design: Translate existing DWH/DB star/srowflake schemas into Databricks-optimized Delta Lake models, implement SCD, fact/dimension modeling, ACID compliance, partitioning etc.
c) Governance, Security & Compliance: Implement data governance, cataloging, lineage using Unity Catalog and AWS Glue; define RBAC, data masking, encryption, etc.
d) Migration Execution Oversight: Work with DEV team for SQL-to-Spark migration; oversee data validation & reconciliation; work with DevOps team to design CI/CD pipelines for Databricks jobs, etc
📌 Data Architect (Kolkata)
🏢 Tata Consultancy Services
📍 Kolkata