18 Aug
|
Xencia Technology Solutions
|
Bengaluru
18 Aug
Xencia Technology Solutions
Bengaluru
Senior Data Engineer
Data Engineering • Full time, Onsite • Bangalore / Chennai / Kochi (Work from Office)
Exp: 4-6 years experience
About the Role
We are looking for a Senior Data Engineer to design, build, and operate the data pipelines and lakehouse platform that power analytics and data products across the business. You will own end-to-end ingestion, transformation, and modeling on Databricks and Microsoft Fabric - turning raw, heterogeneous source data into reliable, well-governed, analytics-ready datasets.
This is a hands-on senior individual-contributor role. Beyond writing production-grade pipelines, you will set engineering standards, review designs, and mentor mid-level engineers on the team. The role is industry-agnostic — you will work across a range of data domains and source systems.
What You'll Do
1. Build & operate pipelines
- Design and maintain scalable batch and streaming data pipelines (ELT/ETL) on Databricks, ingesting from databases, files, APIs, and event streams.
2. Lakehouse & modeling
- Architect and implement a medallion (bronze/silver/gold)
lakehouse on Delta Lake; design dimensional and analytics-ready data models for downstream consumption.
3. Microsoft Fabric delivery
- Deliver data into and across Microsoft Fabric (Lakehouse, Warehouse, OneLake, Pipelines/Dataflows) and enable BI and semantic-model consumption.
4. Orchestration & reliability
- Orchestrate workflows with Airflow and/or Azure Data Factory; build in data-quality checks, monitoring, alerting, and SLAs.
5. Governance
- Implement cataloging, lineage, and access controls using Unity Catalog and Microsoft Purview.
6. Performance & cost
- Tune Spark jobs, storage layout, and cluster configuration for performance and cost efficiency.
7. Standards & mentorship
- Define engineering best practices, conduct design and code reviews, and mentor mid-level data engineers.
What We're Looking For
1. 4–6 years of professional data engineering experience building and operating pro
📌 Senior Data Engineer (Bengaluru)
🏢 Xencia Technology Solutions
📍 Bengaluru