22 Oct
|
Celebal Technologies
|
Jaipur
22 Oct
Celebal Technologies
Jaipur
Job Description: Cloud Infrastructure, DevOps & Databricks Platform Engineer
Experience: 3–5 years
Role Overview
We are looking for an experienced Cloud Infrastructure & DevOps Engineer to design, automate, secure, and manage Azure cloud infrastructure and the Azure Databricks platform. The role involves infrastructure automation, CI/CD, platform administration, governance, monitoring, and production operations.
Key Responsibilities
- Azure Infrastructure: Provision and manage Azure resources, VNets, subnets, NSGs, Private Endpoints, Private DNS, Azure Firewall, Key Vault, and identity/access controls.
- Infrastructure as Code: Develop and maintain reusable Terraform modules for automated, consistent infrastructure provisioning.
- DevOps & CI/CD: Build and manage Azure DevOps YAML pipelines and GitHub Actions for infrastructure and application deployments across Dev, UAT, and Prod.
- Databricks Platform Administration: Administer Azure Databricks workspaces, workspace access, compute resources, cluster policies, SQL warehouses, Unity Catalog, metastore configuration, service principals, and access connectors.
- Databricks DevOps: Automate deployment of notebooks, workflows/jobs, and related configurations across environments using CI/CD and Databricks Asset Bundles.
- Security & Governance: Implement RBAC, least-privilege access, private connectivity, secrets management, security policies, vulnerability remediation, and compliance controls.
- Monitoring & Operations:
Configure Azure Monitor, Log Analytics, alerts, troubleshoot infrastructure and pipeline failures, and support production operations.
- Disaster Recovery & FinOps: Support backup and recovery strategies, DR planning and testing, high availability, resource optimization, and cloud cost management.
Required Technical Skills
- Solid hands-on experience with Microsoft Azure infrastructure and networking.
- Proficiency in Terraform and reusable Infrastructure as Code modules.
- Experience with Azure DevOps, YAML pipelines, GitHub Actions, and Git-based workflows.
- Hands-on experience with Azure Databricks administration, Unity Catalog, access controls, compute management, and workspace governance.
- Understanding of Python, Bash, or PowerShell scripting and automation.
- Knowledge of cloud security, monitoring, troubleshooting, and production support.
Good to Have
- Experience with Azure Kubernetes Service (AKS) and Kubernetes.
- Experience with Databricks Asset Bundles, REST APIs, and automated workspace deployments.
- Exposure to Azure Data Factory, data platform migrations, and DataOps.
- Experience with disaster recovery, business continuity, and FinOps practices.
Candidate Profile
Strong troubleshooting and automation skills, a security-first mindset, and the ability to collaborate with data engineering, security, and application teams to deliver reliable, governed, production-ready cloud and data platforms.
📌 Cloud Infrastructure, DevOps & Databricks Platform Engineer (Jaipur)
🏢 Celebal Technologies
📍 Jaipur