06 Aug
|
Gravity Infosolutions
|
India
06 Aug
Gravity Infosolutions
India
Role: Senior Databricks Engineer
Experience: 5
- years
Work Mode: Remote
Employment Type: Contract
Contract Duration: 6 months+ Extendable
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
- Implement and administer Unity Catalog for enterprise data governance, access control, lineage, and data sharing.
- Support hydrocarbon reporting workflows, including ingestion, transformation, validation, and reconciliation of production and operational data.
- Develop ETL/ELT pipelines using Spark, Delta Lake, and Delta Live Tables (Lakeflow experience is a plus).
- Optimize Databricks workloads for performance, reliability, and cost efficiency.
- Collaborate with business stakeholders to translate reporting requirements into scalable technical solutions.
- Implement data quality checks, monitoring, and automated validation frameworks.
- Work closely with solution architects and data engineers on platform enhancements and production support.
- Document technical designs, governance standards, and operational procedures.
- Participate in code reviews, CI/CD implementation, and DevOps best practices.
Required Qualifications:
- 5+ years of data engineering experience with 3+ years of hands-on Databricks experience.
- Solid experience implementing and managing Unity Catalog in enterprise environments.
- Experience supporting Oil & Gas, Energy, or Hydrocarbon Reporting projects.
- Expertise with:
o Databricks Lakehouse o Apache Spark (PySpark) o Delta Lake o SQL o Python
- Experience building enterprise ETL/ELT pipelines.
- Experience with Azure Databricks (AWS Databricks also considered).
- Strong understanding of data governance, security, metadata management, and lineage.
📌 Sr. Databricks Engineer- Contract (India)
🏢 Gravity Infosolutions
📍 India