02 Oct
|
AuxoAI
|
Bengaluru
Role: Data Engineer – Microsoft Fabric
Location: India (Bangalore, Hyderabad / Mumbai / Gurugram)
Position: Senior Associate
Required Experience: 3–6 years
Role Summary
We’re looking for a skilled Data
Engineer with Microsoft Fabric experience to join our growing data and AI team.
In this role, you will design and build up-to-date data platforms leveraging
Microsoft Fabric, enabling scalable analytics, AI-driven insights, and
enterprise-grade data solutions for global clients. This is an excellent
chance to work on next-generation data architectures, contribute to
AI-driven transformation programs, and grow into advanced data engineering and
platform leadership roles.
Key Responsibilities
• Design, build, and
maintain scalable data pipelines using Microsoft Fabric Data Factory
(Pipelines), Dataflows Gen2, Fabric Notebooks, and Lakehouse.
• Develop and manage
OneLake/Fabric Lakehouse architectures for structured and semi-structured
healthcare and enterprise data.
• Build and optimize batch
and API-based ingestion pipelines from multiple enterprise data sources,
databases, files, and application systems.
• Develop robust ETL/ELT
workflows using SQL, Python, and PySpark for data transformation and
enrichment.
• Implement data quality,
validation, reconciliation, completeness, consistency, and anomaly-detection
checks across source and target datasets.
• Develop data
standardization, deduplication, entity-resolution, record-linkage, and matching
workflows across heterogeneous data sources.
• Design analytics-ready
datasets and data models for data scientists, analysts, ML pipelines, and
downstream applications.
• Collaborate closely with
data scientists and ML engineers to prepare reliable feature-ready and
model-consumable datasets.
• Integrate Microsoft Fabric
with Azure data services such as Azure Data Lake Storage, Azure SQL, Synapse
components, and Power BI where required.
• Implement incremental
ingestion, change-data handling, error handling, ret
📌 Data Engineer – Microsoft Fabric (Bengaluru)
🏢 AuxoAI
📍 Bengaluru