11 Nov
|
Summit Consulting Services
|
Karnataka
11 Nov
Summit Consulting Services
Karnataka
Role Overview
DevOps Engineer to join our DevOps team. The role focuses on CI/CD, infrastructure provisioning, setting management, and production readiness for Databricks, Azure Data Factory, and Azure Data Lake Storage. Working closely with Engineering, QA, and Support teams, you will ensure secure, scalable, and reliable platform Deployments and operations.
Key Responsibilities
- Design, build, and maintain YAML-based CI/CD pipelines using Azure DevOps and/or GitHub Actions.
- Create reusable pipeline templates and manage build agents, runners, dependencies, and execution environments.
- Automate deployment and configuration of:
- Azure Data Factory: pipelines, linked services, datasets, triggers, and environment-specific settings.
- Azure Databricks: jobs, workflows, notebooks or packaged code, dependencies, workspace configuration, and permissions.
- Azure Data Lake Storage: supporting resources, configuration, and access controls.
- Enable controlled deployment of SQL schemas, views, and scripts in partnership with Data Engineering.
- Implement versioned artifacts and controlled promotion across development, QA, staging, and production environments.
- Establish pull-request checks, branch protection, approval gates, automated test integration, post-deployment smoke checks, and rollback procedures.
- Support planned releases and emergency changes through documented, auditable processes.
- Contribute to DevOps standards, documentation, and continuous improvement initiatives
Required Skills & Experience
- 8+ years of relevant engineering experience, including substantial hands-on experience in DevOps, platform engineering and cloud engineering.
- Demonstrated experience supporting and improving production workloads on Microsoft Azure.
- Strong hands-on experience with
- Azure DevOps and/or GitHub Actions, YAML pipelines, reusable templates, and release controls.
- Deploying, managing,
and troubleshooting production workloads on Kubernetes and Azure Kubernetes Service (AKS).
- Practical experience deploying and configuring Azure Data Factory, Databricks, and Azure Data Lake Storage through automated delivery processes.
- Proficiency with Bicep for Azure Infrastructure as Code, including reusable modules and multi-environment deployments.
- Strong Python automation skills and proficiency in PowerShell and/or Bash.
- Working knowledge of Azure compute, networking, storage, identity and access management, private connectivity, and secure configuration.
- Experience with Git workflows, pull requests, branch protection, code reviews, artifact management, and controlled releases.
- Intermediate SQL skills for queries, joins, deployment validation, data checks, and production troubleshooting.
- Practical experience with monitoring, logging, alerting, incident investigation, root-cause analysis, and recovery procedures.
- Experience implementing secrets management, least-privilege access, and secure CI/CD practices.
- Ability to work independently, evaluate technical trade-offs, communicate risks, and maintain clear technical documentation.
- Strong communication and collaboration skills across engineering, QA, security, infrastructure, and support teams.
Nice to Have
- Experience with SQL Server, SSIS, and/or Snowflake deployment and operational tooling.
- Familiarity with .NET/C# build and release processes, including collaboration with developers on deployment, configuration, and runtime issues.
- Experience with Azure Monitor, Log Analytics, or related observability tools.
- Experience with Databricks deployment tooling, job orchestration, cluster policies, or dependency management.
- Exposure to policy-as-code, cloud governance, and compliance-oriented change controls.
- Experience with disaster recovery, resilience testing, capacity planning, and cloud cost optimization.
- Experience in financial services or other environments requiring controlled, auditable production changes.
📌 DevOps Engineer – Azure Data Platform (Karnataka)
🏢 Summit Consulting Services
📍 Karnataka