02 Oct
|
Blumetra Solutions
|
Hyderabad
02 Oct
Blumetra Solutions
Hyderabad
Job Title: Databricks – Lead Data Engineer
Work Location: Hyderabad (Hybrid)
Experience: 7 – 10 years
Role Summary
We are looking for a hands-on Databricks Lead to design, build and take to production governed financial data products on an Azure Databricks lakehouse. You will own the Databricks solution end to end – file-based ingestion, medallion pipelines, hierarchy modelling, row-level security, zero-outage publishing and performance – and lead a small engineering team while working closely with source-system owners, finance stakeholders, and security and platform teams.
What You Will Build
A typical engagement publishes multi-dimensional financial data (for example a management P&L; with entity, department, project, product, version, period and account dimensions) from an enterprise planning system as a single, row-secured consumption table in Databricks, refreshed several times a day. The quality bar:
• Exact reconciliation to source control totals; no data loss.
• Full fidelity of hierarchies, alternate hierarchies, aliases and attributes.
• Zero consumer outage during refresh; a failed run never replaces the last positive data.
• Row-level security that matches the source system's access rules.
• Sub-second response for agreed benchmark queries.
• Additive schema changes absorbed without code changes; full rebuild from Git.
Key Responsibilities
Architecture and technical leadership
• Own the Databricks solution design and drive open decisions with stakeholders: landing zone, publish mechanism, orchestration pattern, compute, retention and recovery targets.
• Translate integration specifications into buildable designs, data contracts and a delivery plan; lead design reviews with integration architects and platform teams.
• Lead, mentor and review the work of 2–4 data engineers; set coding, testing and documentation standards.
• Raise risks early (data volume, security parity, BI connectivity) and propose options with trade-offs.
Platform setup and govern
📌 Databricks Lead (Hyderabad)
🏢 Blumetra Solutions
📍 Hyderabad