Job Description Spectral Consultants is currently hiring for a Senior Data Engineer – Azure Databricks for a leading Qualified Services & Accounting organization.
N n This is an opportunity to work on modern Lakehouse platforms and next-generation AI & Analytics initiatives, building scalable, governed, and AI-ready data solutions using Azure Databricks and the broader Azure ecosystem.
N n Location: Bangalore
N Experience: 5–9 Years
N Work Mode: Hybrid
N n About the Role:-
N n As a Senior Data Engineer, you will design and develop scalable ETL/ELT pipelines and curated Lakehouse data models using Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, and ADLS Gen2. You will collaborate with Analytics, AI/ML, Product, and Business teams to deliver reliable, governed, and AI-ready datasets.
N n Key Responsibilities:-
N
- n
- Design and maintain scalable ETL/ELT pipelines using Azure Databricks. N
- Build data pipelines using Medallion Architecture (Bronze, Silver, Gold). N
- Develop and optimize Delta Lake data models for Analytics and AI/ML use cases. N




- Implement data ingestion using Spark Structured Streaming, Auto Loader, connectors, and Delta Sharing. N
- Manage governed data using Unity Catalog and integrate with ADLS Gen2. N
- Implement data quality,lineage, audit, reconciliation, and governance frameworks. N
- Orchestrate workflows using Databricks Jobs/Workflows and DLT/Lakeflow. N
- Implement CI/CD using Git and Databricks Asset Bundles. N
- Troubleshoot productionissues and collaborate with cross-functional teams to deliver reliable, consumption-ready datasets. N

n n Must-Have Skills:-
N
- n
- 5–8 years of hands-on experience in Data Engineering/Data Integration/Analytics Engineering. N
- Strong expertise in Azure Databricks, PySpark/Spark, and SQL. N
- Hands-on experience with Delta Lake and Medallion Architecture. N
- Strong experience with Unity Catalog and ADLS Gen2. N
- Experience building scalable ETL/E

📌 Hiring: Senior Data Engineer-(Immediate Joiners With Lwd (Bengaluru)
🏢 Spectral Consultants
📍 Bengaluru