13 Sep
|
Tata Consultancy Services
|
India
13 Sep
Tata Consultancy Services
India
Role & responsibilities
Architecture & Strategy
Define enterprise data modernization strategy and target-state architecture leveraging Databricks Lakehouse and dbt.
Design scalable, secure, and high-performance data platforms supporting analytics, AI/ML, reporting, and self-service BI.
Develop migration blueprints for legacy ETL, data warehouses, and reporting platforms.
Create reference architecture, standards, and governance frameworks
Data Platform Migration
Lead migration initiatives from platforms such as:
Teradata, Oracle ,SQL Server ,Netezza ,Hadoop ,Informatica ,Ab Initio ,Talend, Snowflake (optimization/consolidation scenarios)
Assess source systems and define migration patterns, tooling, and execution strategies.
Drive workload transformation to Databricks using Delta Lake, Unity Catalog, and Lakehouse architecture.
Lead ETL/ELT modernization using dbt.
Databricks Architecture
Design and implementation:
Delta Lake architecture
Medallion Architecture (Bronze, Silver, Gold)
Unity Catalog governance model
Data Quality frameworks
Performance optimization strategies
Cost optimization and FinOps practices
Establish best practices around Spark, PySpark, SQL,
and Databricks Workflows.
dbt Leadership
Define enterprise dbt standards and deployment strategies.
Design modular, reusable dbt models and frameworks.
Implement testing, lineage, documentation, and CI/CD pipelines.
Establish best practices for semantic layers and data transformation governance.
Cloud & DevOps
Architect solutions on Azure, AWS, or GCP.
Implement Infrastructure as Code (Terraform preferred).
Integrate CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or GitLab.
Drive DataOps and MLOps practices across teams.
Leadership & Stakeholder Management
Lead teams of architects, data engineers, and consultants.
Conduct architecture reviews and technical governance forums.
Engage business stakeholders to understand transformation goals.
Provide executive-level presentations, estimates, risk assessments, and roadmaps.
Preferred candidate profile
Technical Skills
SQL (Expert Level), PySpark / Spark, Python, Data Modeling (Dimensional & Data Vault) , ETL/ELT Architecture, Data Warehousing Concepts ,API Integrations
📌 Lead Technical Architect Hyderabad (India)
🏢 Tata Consultancy Services
📍 India