13 Aug
|
Dysrupit India
|
Bengaluru
13 Aug
Dysrupit India
Bengaluru
We are seeking a highly skilled Databricks Engineer with deep experience in Unity Catalog and enterprise-scale data platforms to support a major Oil & Gas Hydrocarbon Reporting initiative. The engineer will augment an existing delivery team and contribute across data engineering, governance, optimization, and analytics initiatives on the Databricks Lakehouse Platform.
The ideal candidate has hands-on experience implementing secure, governed data architectures using Unity Catalog and has worked on large-scale regulatory, production, or hydrocarbon reporting programs within the energy sector.
Role & responsibilities
- Design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
- Implement and administer Unity Catalog for enterprise data governance, access control, lineage, and data sharing.
- Support hydrocarbon reporting workflows, including ingestion, transformation, validation, and reconciliation of production and operational data.
- Develop ETL/ELT pipelines using Spark, Delta Lake, and Delta Live Tables (Lakeflow experience is a plus).
- Optimize Databricks workloads for performance, reliability, and cost efficiency.
- Collaborate with business stakeholders to translate reporting requirements into scalable technical solutions.
- Implement data quality checks, monitoring, and automated validation frameworks.
- Work closely with solution architects and data engineers on platform enhancements and production support.
- Document technical designs, governance standards, and operational procedures.
- Participate in code reviews, CI/CD implementation, and DevOps best practices.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related discipline.
- 5+ years of data engineering experience with 3+ years of hands-on Databricks experience.
- Robust experience implementing and managing Unity Catalog in enterprise environments.
- Experience supporting Oil & Gas, Energy, or Hydr
📌 Senior Databricks Engineer (Bengaluru)
🏢 Dysrupit India
📍 Bengaluru