Databricks Senior Engineer Job Description

Role Overview

The Data Senior Engineer will be responsible for designing, building, and optimizing data pipelines and platforms to enable advanced analytics and business intelligence across the organization. This role requires strong expertise in Databricks, SQL, AWS, and Airflow, combined with a solid foundation in data analysis and engineering best practices. The ideal candidate will lead a team of data engineers, collaborate with cross-functional stakeholders, and ensure scalable, secure, and high-performing data solutions.

Location: Bengaluru

Key Responsibilities

Technical Design
- Build design specifications, data models, pipeline patterns, and solution architectures for the workstream.
- Lead the design, development, and maintenance of data pipelines and ETL workflows using Databricks and Airflow.
- Build reusable frameworks, templates, and engineering standards for ETL/ELT, streaming, and batch pipelines.
- Ensure cloud-native designs aligned with AWS platform best practices.

Governance, Security & Optimization




- Ensure data quality, integrity, and governance across data platforms.
- Optimize SQL queries and data models for performance and scalability.
- Build standards for Unity Catalog, lineage, metadata, glossary, and security policies.
- Build data quality frameworks, observability, and operational monitoring.

Cross-Functional Collaboration
- Work closely with stakeholders to understand data requirements and translate them into technical solutions.
- Collaborate with analytics and business teams to deliver actionable insights through BI dashboards and reports.
- Support estimations, and sizing for recent programs and migrations
- Experience in engaging and leading technical discussions with business stakeholders

AI/LLM Enablement (Advantage)
- Design frameworks for agentic workflows, GenAI-based automation, code generation, data quality validation, and metadata enrichment.
- Build Databricks Model Serving, V

📌 Lead AWS Data Engineer (Bengaluru)
🏢 Ascendion Engineering
📍 Bengaluru