The Senior / Principal Data Engineer will design, develop, and maintain scalable data platform and analytics solutions across data lakes and operational databases. This role requires hands-on expertise in Azure Databricks, Azure SQL, Python/PySpark, Notebooks, with a robust understanding of data modeling, ETL/ELT best practices, and CI/CD automation in Azure DevOps. The ideal candidate will have a proven record of building robust, efficient, and secure data pipelines that enable analytics, reporting, and AI/ML solutions, preferably in life sciences, clinical research, or healthcare domains.

Requirements

Design and implement end-to-end data pipelines using Azure Databricks, Azure Data Factory, and ADLS Gen2.
Build scalable and performant data models for data lakes (Medallion architecture), data warehouses, and operational systems.
Develop ELT/ETL frameworks for ingestion from APIs, relational sources, flat files, and third-party systems (e.g., Dynamics 365, Veeva, EDC).
Optimize data transformations, partitioning, and delta lake performance for analytics workloads.




Leverage Python and PySpark for data ingestion, cleansing, enrichment, and advanced transformations.
Implement CI/CD pipelines for data workflows using Azure DevOps and Git, including automated testing, deployment, and monitoring.
Develop and integrate RESTful APIs for cross-system data exchange and automation.
Collaborate with the BI team to ensure clean, high-quality, and accessible data for the Power BI platform.
Support semantic modeling, metric layer design, and data governance best practices.
Enable advanced analytics by provisioning data for ML/AI initiatives and predictive insights.
Collaborate with product/system owners, analysts, and business stakeholders to translate analytical requirements into technical data solutions.
Drive best practices in Agile development, version control, and DevOps workflows.

Benefits

Benefits of working at Allucent include:
Comprehensive benefits package per locati

📌 Data Developer (Bengaluru)
🏢 Allucent
📍 Bengaluru