29 Oct
|
Perficient India
|
Chennai
29 Oct
Perficient India
Chennai
Azure Databricks Architect Location Chennai / Bengaluru / Hyderabad / Nagpur / Pune Experience 10+ Years in Data Engineering, Cloud Architecture, and Big Data Technologies Job Summary We are seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of enterprise-scale data and analytics platforms on Microsoft Azure. The ideal candidate will possess deep expertise in Azure Databricks, data lake architecture, ETL/ELT frameworks, cloud-native data solutions, and contemporary analytics platforms. This role will partner with business stakeholders, data engineers, data scientists, and solution architects to deliver scalable, secure, and high-performing data ecosystems.
Key Responsibilities
Architecture & Design
• Design and implement end-to-end data platforms leveraging Azure Databricks and Azure-native services.
• Define scalable Lakehouse architectures using Delta Lake and Medallion Architecture principles.
• Establish enterprise data models, governance frameworks, and security standards.
• Create architecture blueprints, technical roadmaps, and solution design documents.
• Drive cloud modernization and data migration initiatives. Data Engineering & Analytics
• Design and optimize large-scale data ingestion, transformation, and orchestration pipelines.
• Develop batch and real-time streaming solutions using Databricks Structured Streaming.
• Implement data integration solutions using:
• Azure Data Factory (ADF)
• Azure Synapse Analytics
• Event Hubs
• Azure Functions
• Azure Storage Services
• Enable advanced analytics, AI, and machine learning workloads on Databricks. Platform & Governance
• Implement data governance, lineage, cataloging, and access control strategies.
• Leverage Unity Catalog for centralized data governance.
• Establish CI/CD and DevOps practices for data engineering projects.
• Define monitoring, alerting, performance tuning, and cost optimization strategies.
• Ensure compliance with enterprise security and regulatory requirements. Qualifications
• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years of hands-on experience with Azure Databricks.
• Experience designing and deploying enterprise-scale cloud data platforms.
• Strong understanding of security, governance, and data compliance frameworks. Preferred Certifications
• Microsoft Certified: Azure Solutions Architect Expert
• Microsoft Certified: Azure Data Engineer Associate
• Databricks Certified Data Engineer Professional
• Databricks Certified Solution Architect
• Databricks Certified Machine Learning Professional
📌 Data Architect (Chennai)
🏢 Perficient India
📍 Chennai