The Role

Architect and operate large-scale distributed data platforms using Databricks and Spark.

What You Will Do
Architect Databricks deployments
Optimize Spark and Delta Lake workloads
Implement Infrastructure as Code
Lead incident response
Drive performance standards

What You Will Have
6+ years of data or cloud engineering experience
2+ years operating Databricks in production
2+ years working with Spark
2+ years implementing Infrastructure as Code
Production ownership experience
Responsible for the end-to-end administration, support, and maintenance of enterprise data platforms, including Databricks and Cloudera (CDP/CDH).
Manages Databricks workspaces, compute, Unity Catalog, security, storage integrations, and CI/CD, while supporting Cloudera services such as HDFS, YARN, Hive, Impala, Spark, Oozie, Ranger, Atlas, Kerberos,



and TLS.
Performs platform monitoring, incident troubleshooting, Spark job analysis, log investigation, disk space management, Linux-based operational support (services, processes, file systems, permissions, and logs), performance tuning, upgrades, automation (Ansible/chef/Terraform), capacity planning, and ensures high availability, security, governance, and operational excellence across AWS, Azure, GCP and on-perm Linux settings.
On-Call Support

What Will Set You Apart
Certifications: Databricks, Cloudera, AWS
Streaming architecture experience
AI/ML workload enablement
FinOps cost optimization expertise

📌 Senior Platform Data Engineer Databricks Secunderabad
🏢 Anblicks
📍 Secunderabad