13 Nov
|
MindBrain
|
India
– Data Platform Architect (Lakehouse)
Position: Data Platform Architect – Lakehouse
Experience: 10+ Years
Work Mode: Remote
Employment Type: Contract
Job Overview
We are looking for an experienced Data Platform Architect – Lakehouse with strong expertise in designing and implementing large-scale, enterprise-grade lakehouse architectures. The ideal candidate must have hands-on experience delivering at least three production-grade lakehouse implementations, each handling a minimum of 25 TB of data.
The candidate should possess deep knowledge of modern data platforms, data engineering architecture, ETL/ELT pipelines, change data capture (CDC), unified data catalogues, data quality frameworks, and semantic layers.
Key Responsibilities
- Design and architect scalable, enterprise-grade Lakehouse platforms.
- Lead end-to-end architecture and implementation of large-scale data lakehouse solutions.
- Design and optimize ETL/ELT pipelines for efficient data ingestion, transformation, and processing.
- Implement and manage Change Data Capture (CDC) mechanisms for real-time and incremental data processing.
- Design and implement unified data catalogues for metadata management, data discovery, and governance.
- Establish enterprise-wide data quality frameworks to ensure data accuracy, consistency, and reliability.
- Design and develop semantic layers to enable standardized data access, business intelligence, and analytics.
- Ensure platform scalability, performance,
security, governance, and reliability.
- Provide technical leadership and architectural guidance to data engineering teams.
Mandatory Skills & Experience
- 10+ years of overall experience in Data Engineering / Data Architecture.
- Proven experience delivering at least 3 production-grade Lakehouse implementations.
- Each Lakehouse implementation must handle at least 25 TB of data.
- Strong expertise in ETL/ELT architecture and development.
- Hands-on experience with Change Data Capture (CDC).
- Experience designing and implementing unified data catalogues.
- Robust understanding of data quality frameworks and governance.
- Experience designing and implementing semantic layers.
- Expertise in large-scale data platform architecture, scalability, and performance optimization.
Preferred Qualifications
- Experience with modern Lakehouse technologies and cloud-based data platforms.
- Knowledge of enterprise data governance, metadata management, and data observability.
- Experience working with large-scale distributed data processing frameworks.
- Strong communication, architectural decision-making, and problem-solving skills.
Candidate Requirements Candidates must have demonstrable experience in at least three production Lakehouse builds, each with a minimum data scale of 25 TB. Experience limited to POCs or theoretical implementations will not be considered.
📌 Data Platform Architect (Lakehouse) (10+ yrs)
🏢 MindBrain
📍 India