30 Jul
|
cirruslabs
|
Telangana
30 Jul
cirruslabs
Telangana
Location : India
Shift time :2 PM to 11 PM
Role & responsibilities
Job Description:
We are seeking a Senior Databricks Platform Engineer to support architecture, operational engineering, platform enablement, and modernization activities across this evolving environment.This role blends:• Databricks platform expertise• Cloud infrastructure awareness• DevOps-aligned engineering• operational platform supportThe ideal candidate understands how Databricks workloads, APIs, pipelines, storage layers, and operational processes integrate within broader enterprise cloud ecosystems.---Role OverviewThe Senior Databricks Platform Engineer will support the design, operational enablement, modernization, and ongoing support of enterprise Databricks platforms and associated data processing environments.This engineer will work closely with:• Cloud platform teams• DevOps organizations• Infrastructure engineering teams• Application modernization groups• data and analytics stakeholdersThe role requires strong awareness of how Databricks modernization activities impact:• Existing CI/CD pipelines• Automation frameworks• Operational governance• Enterprise cloud platform standards---Key ResponsibilitiesDatabricks Platform Engineering & Operations• Support architecture and operational engineering across enterprise Databricks environments• Design and maintain scalable Lakehouse, Delta Lake, and Unity Catalog solutions• Support administration of:o Databricks Workspaceso Jobso Notebookso Clusters• Optimize Spark workloads, cluster configurations, and platform performance• Support batch and streaming data processing workloads• Assist with multi-environment platform management across Dev, QA,
and Production---Platform Integration & DevOps Alignment• Support integration of Databricks platforms with Azure-native ecosystems and enterprise applications• Work across integrations involving:o APIso Azure Storage Accountso Data Lakeso reporting and analytics platforms• Collaborate with platform and DevOps teams to align Databricks activities with existing CI/CD and automation standards• Support deployment workflows utilizing:o GitHubo Azure DevOpso Infrastructure as Code frameworks• Help ensure modernization activities do not disrupt existing automated deployment pipelines and operational processes---Governance, Reliability & Platform Support• Support governance, access management, monitoring, logging, and operational security practices• Assist with implementation of:o RBACo lineageo encryptiono platform governance controls• Participate in troubleshooting, operational support, and root cause analysis activities• Contribute to documentation, operational standards, and platform best practices---Required Qualifications• 6+ years of experience within cloud, platform engineering, data engineering, or enterprise analytics ecosystems• 3+ years of hands-on experience supporting enterprise Databricks environments• Strong experience with:o Delta Lakeo Unity Catalogo Spark workloadso cluster operationso Databricks Workspaces• Experience with Azure cloud services and cloud-native platform concepts• Familiarity with:o Azure DevOpso GitHub workflowso CI/CD pipeline conceptso deployment automation• Experience supporting APIs, distributed application integrations, and enterprise data platforms• Strong troubleshooting and operational support capabilities• Strong communication and stakeholder collaboration skills---Preferred Qualifications• Experience with:o PySparko Pythono SQLo Spark SQLo Scala• Familiarity with:o AKS/Kuberneteso Terraformo Bicepo Infrastructure as Code practices• Experience with:o Azure Data Lakeo Event Hubo streaming architectureso enterprise analytics environments• Familiarity with monitoring and observability platforms such as:o Azure Monitoro Datadog• Exposure to enterprise modernization and cloud migration initiatives---What This Role Is• A hands-on enterprise Databricks platform engineering role• A modernization-focused engineering chance within a large Azure ecosystem• A hybrid role spanning cloud integration, operational engineering, and DevOps-aware platform support• A collaborative engineering role supporting scalable enterprise data and analytics platforms---What This Role Is Not• A pure data scientist or analytics-only role• A narrowly scoped ETL development position• A traditional infrastructure administration role• A short-term migration-only engagement---Why Work With UsYou will be joining a globally recognized consulting and technology organization supporting enterprise-scale transformation initiatives across:• Azure cloud platforms• platform engineering• DevOps and automation• large-scale data modernization• Analytics and AI-enabled ecosystemsThis role provides the opportunity to help shape and support modern enterprise data platform operations within a highly collaborative global engineering environment.
📌 Databricks Platform Engineer/ Admin (Telangana)
🏢 cirruslabs
📍 Telangana