03 Oct
|
AuxoAI
|
Bengaluru
Role: Data Engineer – Microsoft Fabric
Location: India (Bangalore, Hyderabad / Mumbai / Gurugram)
Position: Senior Associate
Required Experience: 3–6 years
Role Summary
We’re looking for a skilled Data
Engineer with Microsoft Fabric experience to join our growing data and AI team.
In this role, you will design and build modern data platforms leveraging
Microsoft Fabric, enabling scalable analytics, AI-driven insights, and
enterprise-grade data solutions for global clients. This is an excellent
prospect to work on next-generation data architectures, contribute to
AI-driven transformation programs, and grow into advanced data engineering and
platform leadership roles.
Key Responsibilities
• Design, build, and
maintain scalable data pipelines using Microsoft Fabric Data Factory
(Pipelines), Dataflows Gen2, Fabric Notebooks, and Lakehouse.
• Develop and manage
OneLake/Fabric Lakehouse architectures for structured and semi-structured
healthcare and enterprise data.
• Build and optimize batch
and API-based ingestion pipelines from multiple enterprise data sources,
databases, files, and application systems.
• Develop robust ETL/ELT
workflows using SQL, Python, and PySpark for data transformation and
enrichment.
• Implement data quality,
validation, reconciliation, completeness, consistency, and anomaly-detection
checks across source and target datasets.
• Develop data
standardization, deduplication, entity-resolution, record-linkage, and matching
workflows across heterogeneous data sources.
• Design analytics-ready
datasets and data models for data scientists, analysts, ML pipelines, and
downstream applications.
• Collaborate closely with
data scientists and ML engineers to prepare reliable feature-ready and
model-consumable datasets.
• Integrate Microsoft Fabric
with Azure data services such as Azure Data Lake Storage, Azure SQL, Synapse
components, and Power BI where required.
• Implement incremental
ingestion, change-data handling, error handling, ret
📌 Data Engineer – Microsoft Fabric (Bengaluru)
🏢 AuxoAI
📍 Bengaluru