06 Aug
|
Gravity Infosolutions
|
India
06 Aug
Gravity Infosolutions
India
Role: Senior Databricks Engineer
Experience: 5+ years
Work Mode: Remote
Employment Type: Contract
Contract Duration: 6 months+ Extendable Key Responsibilities: Design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
Implement and administer Unity Catalog for enterprise data governance, access control, lineage, and data sharing.
Support hydrocarbon reporting workflows, including ingestion, transformation, validation, and reconciliation of production and operational data.
Develop ETL/ELT pipelines using Spark, Delta Lake, and Delta Live Tables (Lakeflow experience is a plus).
Optimize Databricks workloads for performance, reliability, and cost efficiency.
Collaborate with business stakeholders to translate reporting requirements into scalable technical solutions.
Implement data quality checks, monitoring, and automated validation frameworks.
Work closely with solution architects and data engineers on platform enhancements and production support.
Document technical designs, governance standards, and operational procedures.
Participate in code reviews, CI/CD implementation, and DevOps best practices.
Required
Qualifications
5+ years of data engineering experience with 3+ years of hands-on Databricks experience.
Robust experience implementing and managing Unity Catalog in enterprise environments.
Experience supporting Oil & Gas, Energy, or Hydrocarbon Reporting projects.
Expertise with
o Databricks Lakehouse o Apache Spark (PySpark)
o Delta Lake o SQL o Python
Experience building enterprise ETL/ELT pipelines.
Experience with Azure Databricks (AWS Databricks also considered).
Strong understanding of data governance, security, metadata management, and lineage.
📌 Sr. Azure Databricks Engineer - Contract (India)
🏢 Gravity Infosolutions
📍 India