"This offshore Platform Engineer role focuses on administering and operating Databricks environments, including clusters, jobs, and workflows, to support enterprise Agentic AI solutions.
Key responsibilities include managing Unity Catalog for data governance, implementing CI/CD pipelines, and enforcing security and cost controls through cluster policies.
The engineer will also oversee Spark Structured Streaming pipelines, ensuring reliable data ingestion from messaging services like Kafka.
Monitoring platform health via Azure Monitor and Dynatrace, alongside troubleshooting performance and scaling issues, is critical to the role.
Candidates require 4+ years of Databricks/Spark experience, proficiency in Terraform and Git-based CI/CD, and robust skills in Python and SQL.
The position demands a bachelor’s degree, with preferred skills including Databricks certifications and familiarity with ITIL service management processes"
Key Job Details
Primary Location
Bangalore, Karnataka, India
Job Type
Experienced
Required Experience
7
Skill
Data-Databricks with Azure Native Services, Spark,Python/Scala/Java,Kafka,HDFS, Hive.