12 Sep
|
Xencia Technology Solutions
|
Bengaluru
12 Sep
Xencia Technology Solutions
Bengaluru
Job DescriptionSenior Data Engineer
NData Engineering
n
N
- Full-time, Onsite
n
- Bangalore / Chennai / Kochi (Work from Office)
N
nExp: 4-6 years experience
NAbout the Role
nWeare looking for a Senior Data Engineer to design, build, and operate the data pipelines and lakehouse platform that power analytics and data products across the business. You will own end-to-end ingestion, transformation, and modeling on Databricks and Microsoft Fabric - turning raw, heterogeneous source data into reliable, well-governed, analytics-ready datasets.
NThis is a hands-on seniorindividual-contributor role. Beyond writing production-grade pipelines, you will set engineering standards, review designs, and mentor mid-level engineers on the team. The role is industry-agnostic — you will work across a range of data domains and source systems.
NWhat You'll Do
n
n
- Build & operate pipelines - Design and maintain scalable batch and streaming data pipelines (ELT/ETL) on Databricks, ingesting from databases, files, APIs, and event streams.
N
- Lakehouse & modeling - Architect and implement a medallion (bronze/silver/gold) lakehouse on Delta Lake;
design dimensional and analytics-ready data models for downstream consumption.
N
- Microsoft Fabric delivery - Deliver data into and across Microsoft Fabric (Lakehouse, Warehouse, OneLake, Pipelines/Dataflows) and enable BI and semantic-model consumption.
N
- Orchestration & reliability - Orchestrate workflows with Airflow and/or Azure Data Factory;
build in data-quality checks, monitoring, alerting, and SLAs.
N
- Governance - Implement cataloging, lineage, and access controls using Unity Catalog and Microsoft Purview.
N
- Performance & cost - Tune Spark jobs, storage layout, and cluster configuration for performance and cost efficiency.
N
- Standards & mentorship - Define engineering best practices, conduct design and code reviews, and mentor mid-level data engineers.
N
nWhat We're LookingFor
N
n
- 4–6 years of skilled data engineering experience building and operating production data pipelines.
N
- Strong hands-on experience with Databricks - Spark (PySpark/Spark SQL), Delta Lake, notebooks/jobs, and cluster management.
N
- Proven experience designing and building data pipelines (batch and streaming) at scale, with a solid grasp of ELT/ETL patterns.
N
- Experience with Microsoft Fabric - Lakehouse, Warehouse, OneLake, and Fabric Pipelines/Dataflows.
N
- Strong data modeling skills - medallion/lakehouse architecture and dimensional modeling.
N
- Proficiency in Python and advanced SQL.
N
- Experience with workflow orchestration (Airflow and/or Azure Data Factory).
N
- Experience with data governance tooling (Unity Catalog and/or Microsoft Purview).
N
- Experience with streaming ingestion (Kafka / Event Hubs and Spark Structured Streaming).
N
- Ability to work independently, set technical direction, and mentor others.
N
nNice to Have
n
N
- AWS data experience - S3, Glue, Redshift, EMR, Athena, or Lake Formation (a strong plus).
N
- Infrastructure-as-code and CI/CD for data (Terraform, Git-based deployment, automated testing).
N
- Experience with dbt fortransformation and testing.
N
- Familiarity with Power BI semantic models and BI enablement.
N
- Databricks or Microsoft(Azure) certifications.
N
nTechnology Stack
NDatabricks: Apache Spark (PySpark, Spark SQL), Delta Lake, Databricks Workflows/Jobs, Unity Catalog, Delta Live Tables.
NMicrosoft / Fabric: Microsoft Fabric (Lakehouse, Warehouse, OneLake, Pipelines, Dataflows Gen2), Azure Data Factory, Azure Data Lake Storage, Microsoft Purview, Power BI.
NPipelines & Orchestration: Apache Airflow, Azure Data Factory, Kafka / Azure Event Hubs, Spark Structured Streaming.
NLanguages & Tooling: Python, SQL, Git, CI/CD, Terraform, dbt.
NAWS (plus): S3, AWS Glue, Amazon Redshift, EMR, Athena, Lake Formation.
NWhy Join Us
nYou'll take real ownership of a modern lakehouse platform, work across a broad set of data domains, and shape how the team builds data. We value skills and impact over formal credentials — there is no degree or certification requirement for this role.
📌 Hiring: Senior Data Engineer (Bengaluru)
🏢 Xencia Technology Solutions
📍 Bengaluru