Specialist - Data Engineering (Kolkata)

Specialist - Data Engineering (Kolkata)

20 Oct
|
LTM
|
Kolkata

20 Oct

LTM

Kolkata

Role description

Azure Databricks Platform Administrator

Experience 5 Years Role Type FullTime

Job Summary

We are seeking an experienced Azure Databricks Platform Administrator to design operate secure and optimize enterprisescale Databricks environments on Microsoft Azure The role is responsible for platform governance workspace administration identity and access management networking security monitoring automation cost optimization and production support The ideal candidate combines robust Azure infrastructure knowledge with handson Databricks administration and works effectively with data engineering analytics security cloud and application teams

Key Responsibilities

Administer Azure Databricks accounts workspaces clusters cluster policies pools SQL warehouses jobs notebooks repositories libraries and access controls across development test and production environments

Manage workspace provisioning and configuration using Infrastructure as Code and automated deployment pipelines

Implement identity and access management through Microsoft Entra ID single signon service principals managed identities groups rolebased access control and SCIM provisioning

Administer Unity Catalog including metastores catalogs schemas tables volumes storage credentials external locations privileges and dataaccess governance

Configure secure Azure networking including virtual network injection private endpoints Private Link network security groups route tables DNS firewalls and controlled egress

Integrate Databricks with Azure Data Lake Storage Key Vault Azure DevOps or GitHub monitoring platforms and other approved enterprise services

Establish cluster standards runtime policies library controls tagging autoscaling autotermination and workload isolation

Monitor platform availability performance capacity audit logs job health and security events build dashboards and actionable s

Lead incident problem change release and servicerequest management for the platform meeting agreed service levels and operational KPIs

Troubleshoot complex workspace compute authentication authorization connectivity storage Spark and integration issues





Optimize platform cost through usage analysis rightsizing policy enforcement commitment utilization chargebackshowback and removal of idle resources

Plan and execute Databricks Runtime upgrades platform changes vulnerability remediation businesscontinuity testing and disasterrecovery activities

Define and maintain platform standards runbooks architecture diagrams operating procedures support documentation and knowledge articles

Partner with engineering architecture security compliance FinOps and vendor teams to onboard workloads and drive continuous improvement

Mentor junior administrators and provide technical leadership for platform operations and governance

Required Qualifications and Experience

5 years of experience in cloud dataplatform infrastructure DevOps or productionsupport roles including substantial handson administration of Azure Databricks

Strong understanding of Azure Databricks architecture control plane and data plane concepts workspaces compute jobs SQL warehouses Delta Lake and Unity Catalog

Handson experience with core Azure services such as Microsoft Entra ID Azure Data Lake Storage Gen2 Key Vault Virtual Network Private Link Azure Monitor Log Analytics and Azure DevOps

Strong knowledge of cloud security leastprivilege access secrets management encryption network isolation auditability and enterprise governance

Experience automating Azure and Databricks administration using Terraform Bicep or ARM templates Databricks Asset Bundles Azure CLI Databricks CLI REST APIs PowerShell Python or shell scripting

Experience building and supporting CICD pipelines for infrastructure and platform configuration

Working knowledge of Apache Spark Python SQL Delta Lake and common dataengineering workload patterns

Strong troubleshooting skills across identity networking compute storage security and distributed dataprocessing layers





Experience operating production platforms using ITILaligned incident problem change release capacity and servicelevel management practices

Bachelors degree in Computer Science Information Technology Engineering or a related discipline or equivalent practical experience

Technical Competencies

Databricks Account Console workspace administration compute cluster policies jobs SQL warehouses Unity Catalog Delta Lake audit logs system tables authentication and REST APIs

Azure Entra ID ADLS Gen2 Key Vault Virtual Network Private Link Azure Monitor Log Analytics Azure Policy and Azure DevOps

Automation and DevOps Terraform Bicep or ARM Git CICD Databricks Asset Bundles PowerShell Python shell scripting and com

Skills

Mandatory Skills : AZURE DATA LAKE, Azure SQL, Databricks

About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert

📌 Specialist - Data Engineering (Kolkata)
🏢 LTM
📍 Kolkata

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: specialist - data engineering (kolkata) / kolkata