19 Nov
|
Cloud Raptor
|
Bengaluru
19 Nov
Cloud Raptor
Bengaluru
Job Title: Databricks Architect
Location: India - Bengaluru
Experience: 10+ Years
Primary Skills: Databricks, PySpark, SQL, Python, Unity Catalog, AWS
Job Summary
We are looking for an experienced Databricks Architect with 10+ years of experience in data engineering and cloud based data platforms. The ideal candidate should have strong expertise in designing, developing, and managing scalable data solutions using Databricks, PySpark, Python, SQL, and AWS.
Responsibilities
• Design and implement scalable, high-performance data architectures using Databricks on AWS.
• Develop and optimize ETL/ELT pipelines using PySpark, Python, and SQL.
• Implement Unity Catalog for data governance, access control, and security.
• Manage Databricks administration, including workspace configuration, cluster management, permissions, and performance optimization.
• Design and implement Lakehouse architecture using Delta Lake and Databricks.
• Establish CI/CD processes using GitHub for version control and deployment.
• Collaborate with cross-functional teams and manage development activities using Jira.
• Provide technical leadership, architecture guidance,
and best practices for data engineering teams.
Required Skills
• 10+ years of overall IT experience, with solid expertise in data engineering and architecture.
• Hands-on experience with Databricks, PySpark, Python, and advanced SQL.
• Strong knowledge of Unity Catalog, Delta Lake, and Databricks administration.
• Experience with AWS Cloud services, including S3, IAM, Glue, and related data services.
• Experience with GitHub, CI/CD pipelines, and Jira.
• Strong understanding of data governance, security, performance tuning, and cost optimization.
• Excellent problem-solving, communication, and stakeholder management skills.
Preferred Qualifications
• Experience designing enterprise-scale Lakehouse architectures.
• Familiarity with Databricks Workflows, Delta Live Tables/Lakeflow, and infrastructure automation.
• Databricks or AWS certifications would be an added advantage.
• Ideal Candidate: A hands-on Databricks Architect capable of driving end-to-end architecture, development, administration, and governance of enterprise data platforms on AWS.
📌 Databricks Architect (Bengaluru)
🏢 Cloud Raptor
📍 Bengaluru