ADF Senior Technical Specialist

Experience: Not Available to Not Available years

Location: Hyderabad, India

Skills: Databricks, AWS, Delta Lake, S3, Python, SQL, medallion architecture, alerting, pipeline observability, data privacy, compliance, security best practices, Infrastructure as Code (IaC), CI/CD, Informatica, SAP Analytics, Genie spaces, Databricks applications, Mosaic AI Agent Framework, Model Training

Job Summary

Highly skilled Databricks Platform Specialist to oversee, secure, and optimize our enterprise data ecosystem on AWS. In this role, you will be the core architect of our Databricks workspace administration, governance framework, and multi-source data integrations. You will bridge the gap between infrastructure automation and data engineering, ensuring our medallion architecture is scalable, highly secure, cost-effective, and fully observable.

Key Responsibilities

Strong hands-on experience with Databricks Platform Engendering and Administration

- Disaster Recovery - Multi region
- Workspace Management
- Unity Catalog Management - Familiarity with Unity Catalog and Databricks governance features.
- User Management
- Governance & Security
- Infrastructure as Code (IaC) & Automation - CI/CD
- Optimization, Monitoring & Operations
- Dashboards - Cost monitoring




- Data source connections - Data bricks, Informatica, SAP Analytics [cloud] and other different data sources Genie spaces, Databricks applications
- Mosaic AI Agent Framework/ Model Training

Skill Requirements

Strong hands-on experience with Databricks on AWS, including Delta Lake and S3.

- Proficiency in Python and SQL for data engineering tasks.
- Experience working within a medallion architecture framework.
- Experience with model monitoring, alerting, and pipeline observability.
- Strong documentation and communication skills.
- Ability to quickly integrate into an existing team and architecture.
- Familiarity with data privacy, compliance, and security best practices in cloud environments.

Other Requirements

Strong hands-on experience with Databricks on AWS, including Delta Lake and S3.

- Proficiency in Python and SQL for data engineering tasks.
- Experience working within a medallion architecture framework.
- Experience with model monitoring, alerting, and pipeline observability.
- Solid documentation and communication skills.
- Ability to quickly integrate into an existing team and architecture.
- Familiarity with data privacy, compliance, and security best practices in cloud environments.

📌 ADF Senior Technical Specialist (India)
🏢 HCL Technologies
📍 India