27 Aug
|
Hawk Sense Business Solutions(formerly known as Hawk Sense Security Systems
|
Bangalore Metropolitan Area
27 Aug
Hawk Sense Business Solutions(formerly known as Hawk Sense Security Systems
Bangalore Metropolitan Area
Senior Data Cloud Engineer – Databricks & Azure + JAVA Job Details
Role:
Senior Data Cloud Engineer
Experience:
4–6 Years
Location:
Bangalore
Notice Period:
Immediate to 30 Days
Budget:
Up to ₹27 LPA
Work Mode:
As per business requirement
Role Overview
We are looking for a Senior Data Cloud Engineer with 4–6 years of strong experience in Azure Data Engineering and Databricks
. The ideal candidate should have hands-on expertise in Databricks REST APIs, Databricks SDK (Python/Java), and Databricks CLI
, along with strong experience in developing Java/Spring Boot microservices and REST APIs
.
The candidate will be responsible for designing and developing API-driven Databricks integrations, automating Databricks administration and deployments, and building scalable cloud data engineering solutions.
Top 3 Mandatory Skills
1. Databricks REST API – MUST
2. Databricks SDK (Python/Java) – MUST
3. Databricks CLI – MUST
Key Responsibilities
- Design and develop integrations using Databricks REST APIs, SDKs, and automation frameworks .
- Create and manage Databricks Jobs, Workflows, Clusters, Repos, Unity Catalog, and Workspace resources through APIs.
- Develop API-driven solutions for orchestrating Databricks notebooks, jobs, and streaming pipelines.
- Integrate Databricks with enterprise applications, microservices, and external platforms using REST APIs.
- Understand business requirements related to data ingestion and cloud data engineering.
- Work with data modelers to translate business requirements into cloud/on-premise data engineering solutions.
- Develop and maintain Databricks and Azure Data Factory (ADF) pipelines
.
- Automate Databricks administration, deployment, monitoring, and operational activities.
- Develop scalable and reusable data engineering solutions on Microsoft Azure.
- Implement proactive and reactive application self-healing solutions through automation.
- Collaborate with development, data, architecture, and business teams to deliver high-quality solutions.
Technical Requirements Databricks
- Strong hands-on experience with Databricks REST API .
- Strong experience with Databricks SDK using Python or Java .
- Hands-on experience with Databricks CLI .
- Strong understanding of
- Databricks Jobs API
- Clusters API
- Workspace API
- SQL Execution API
- Unity Catalog API
- Delta Sharing API
- Experience managing Databricks Jobs, Workflows, Clusters, Repos, and Workspace resources.
- Experience automating Databricks deployment and administration.
Azure Data Engineering
- 4+ years of strong experience in Azure Data Engineering and Databricks .
- Hands-on experience developing Azure Data Factory pipelines .
- Strong understanding of cloud-based data ingestion and transformation.
- Experience designing and implementing scalable cloud data engineering workloads.
- Microsoft Azure cloud deployment experience is preferred.
Java / Microservices
- Experience developing Java/Spring Boot microservices .
- Strong experience developing REST APIs .
- Experience integrating enterprise applications with Databricks through APIs and microservices.
- Ability to develop scalable and maintainable API-driven solutions.
API Security Strong understanding of API and cloud security concepts, including:
- OAuth 2.0
- IDP / Identity Providers
- JWT
- Service Principals
- RBAC
- Secrets Management
Required Qualifications & Experience
- 4–6 years of overall experience in cloud data engineering and transformation.
- 4+ years of strong experience in Azure Data Engineering and Databricks .
- Mandatory hands-on experience with:
- Databricks REST API
- Databricks SDK – Python/Java
- Databricks CLI
- Experience integrating Databricks with enterprise applications through APIs and microservices.
- Strong knowledge of Databricks APIs and automation.
- Experience developing Java/Spring Boot microservices and REST APIs .
- Experience with Azure Data Factory and cloud data pipelines.
- Experience with application self-healing and automated operational solutions is preferred.
- Bachelor's degree in Computer Science, Information Technology, Engineering, Computer/Telecommunication Engineering , or an equivalent discipline.
Preferred Candidate Profile The ideal candidate should be a hands-on Azure + Databricks engineer who combines robust data engineering capabilities with API development and automation expertise. Candidates without hands-on experience in Databricks REST API, Databricks SDK, and Databricks CLI should not be considered
, as these are mandatory skills for the role.
Compensation & Joining Details
- Budget:
Up to ₹27 LPA
- Location:
Bangalore
- Experience: 4–6 Years
- Notice Period:
Immediate to 30 Days
📌 Data Cloud Engineer (Bangalore Metropolitan Area)
🏢 Hawk Sense Business Solutions(formerly known as Hawk Sense Security Systems
📍 Bangalore Metropolitan Area