24 Aug
|
DataE2E Technologies
|
India
24 Aug
DataE2E Technologies
India
Job Title: Principal Architect
Job Location: 100% Remote
Job Type: Full Time/ Permanent
Shift : 3 pm – 11 pm IST
Job Descriptio
nKey Responsibilitie
sEnterprise Migration: Lead end-to-end migration initiatives, transitioning legacy data warehouses, platforms, and pipelines onto modern Databricks architecture with minimal business disruption
.Platform Roadmap: Define the evolution of the Azure/Databricks platform, ensuring it remains at the cutting edge of industry standards post-migration
.Innovation & POCs: Evaluate and pilot current technologies (e.g., SODA for data quality, Astronomer for orchestration) to solve emerging enterprise needs
.Complex Problem Solving: Architect solutions for business-critical hurdles, such as Databricks workspace segmentation, global data residency restrictions, and multi-tenant scaling
.FinOps & Optimization:
Lead initiatives to optimize Databricks consumption and cloud spend without sacrificing performance
.Enterprise Integration: Design complex integration patterns (CDC, Databricks Asset Bundles) for large-scale systems like Warehouse Management (MAWM, PKMS) and AI products (QEval)
.
Requiremen
ts10+ years in Data Architecture, with 5+ years in a Principal/Lead capacity at a large enterpris
e.Proven track record of executing enterprise-scale migrations to Databricks from legacy platforms or cloud environment
s.Deep mastery of the Azure Data Stack and Databricks ecosystem (Unity Catalog, Delta Live Tables, Delta Lake
).Demonstrated ability to lead R&D;/POC initiatives and transition them seamlessly into productio
n.
📌 Principal Architect (India)
🏢 DataE2E Technologies
📍 India