Data Engineering Lead-
Microsoft Fabric
Company Overview

Boston Insights is an innovative startup creating competitive advantage for pharmaceutical companies by unlocking their clinical supply chain data and enabling end-to-end visibility. We augment risk resiliency and agility to ensure uninterrupted supply of investigational drugs to patients on-time. Our mission is to transform how pharmaceutical companies manage their clinical supply chains through cutting-edge data solutions.

Position Overview

We are seeking a Data Engineer with 5+ years of experience, deep expertise in the Microsoft Azure technology stack, and proven ability in integrating data from external data lakes, AWS data warehouses, and enterprise supply chain solutions like SAP. The ideal candidate will also have robust experience in data governance, building data automation tools using Python and related languages, and developing AI agents using Microsoft Fabric AI capabilities, Fabric Data Agents, and Fabric-native data infrastructure to support governed data discovery, lineage, quality checks, compliance workflows,



and intelligent data operations.

Key Responsibilities

Data Integration, Pipeline Development & Maintenance
- Lead the integration strategy for ingesting and harmonizing data from external sources, including AWS-based data lakes/warehouses (such as S3, Redshift) and SAP systems.
- Design, build, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake/ MS Fabric OneLake
- Design reusable metadata-driven ingestion framework for rapid on-boarding of new datasets.
- Hands-on experience in
metadata driven pipelines with event-based ingestion
- Automate ETL processes for data extraction, transformation, and loading across hybrid and multi-cloud environments.
- Build and maintain real-time and batch data integration workflows between Azure, AWS, and on-premises sources.

Data Architecture & Infrastructure
- Design and implement data lake a

📌 Lead Data Engineer (India)
🏢 Boston Insights
📍 India