13 Nov
|
MindBrain
|
India
Job Description
– Data Platform Architect (Lakehouse) Position: Data Platform Architect – Lakehouse
Experience:
10+ Years Work Mode: Remote Employment Type: Contract Job Overview We are looking for an experienced Data Platform Architect – Lakehouse with strong expertise in designing and implementing large-scale, enterprise-grade lakehouse architectures. The ideal candidate must have hands-on experience delivering at least three production-grade lakehouse implementations, each handling a minimum of 25 TB of data. The candidate should possess deep knowledge of modern data platforms, data engineering architecture, ETL/ELT pipelines, change data capture (CDC), unified data catalogues, data quality frameworks, and semantic layers.
Key Responsibilities
• Design and architect scalable, enterprise-grade Lakehouse platforms.
• Lead end-to-end architecture and implementation of large-scale data lakehouse solutions.
• Design and optimize ETL/ELT pipelines for efficient data ingestion, transformation, and processing.
• Implement and manage Change Data Capture (CDC) mechanisms for real-time and incremental data processing.
• Design and implement unified data catalogues for metadata management, data discovery, and governance.
• Establish enterprise-wide data quality frameworks to ensure data accuracy, consistency, and reliability.
• Design and develop semantic layers to enable standardized data access, business intelligence, and analytics.
• Ensure platform scalability,
performance, security, governance, and reliability.
• Provide technical leadership and architectural guidance to data engineering teams. Mandatory Skills & Experience
• 10+ years of overall experience in Data Engineering / Data Architecture.
• Proven experience delivering at least 3 production-grade Lakehouse implementations.
• Each Lakehouse implementation must handle at least 25 TB of data.
• Strong expertise in ETL/ELT architecture and development.
• Hands-on experience with Change Data Capture (CDC).
• Experience designing and implementing unified data catalogues.
• Strong understanding of data quality frameworks and governance.
• Experience designing and implementing semantic layers.
• Expertise in large-scale data platform architecture, scalability, and performance optimization. Preferred Qualifications
• Experience with contemporary Lakehouse technologies and cloud-based data platforms.
• Knowledge of enterprise data governance, metadata management, and data observability.
• Experience working with large-scale distributed data processing frameworks.
• Strong communication, architectural decision-making, and problem-solving skills. Candidate Requirements Candidates must have demonstrable experience in at least three production Lakehouse builds, each with a minimum data scale of 25 TB. Experience limited to POCs or theoretical implementations will not be considered.
📌 Data Platform Architect (India)
🏢 MindBrain
📍 India