The Senior / Principal Data Engineer will design, develop, and maintain scalable data platform and analytics solutions across data lakes and operational databases. This role requires hands-on expertise in Azure Databricks, Azure SQL, Python/PySpark, Notebooks, with a strong understanding of data modeling, ETL/ELT best practices, and CI/CD automation in Azure DevOps. The ideal candidate will have a proven record of building robust, productive, and secure data pipelines that enable analytics, reporting, and AI/ML solutions, preferably in life sciences, clinical research, or healthcare domains.

Requirements
- Design and implement end-to-end data pipelines using Azure Databricks, Azure Data Factory, and ADLS Gen2.
- Build scalable and performant data models for data lakes (Medallion architecture), data warehouses, and operational systems.
- Develop ELT/ETL frameworks for ingestion from APIs, relational sources, flat files, and third-party systems (e.g., Dynamics 365, Veeva, EDC).
- Optimize data transformations, partitioning, and delta lake performance for analytics workloads.




- Leverage Python and PySpark for data ingestion, cleansing, enrichment, and advanced transformations.
- Implement CI/CD pipelines for data workflows using Azure DevOps and Git, including automated testing, deployment, and monitoring.
- Develop and integrate RESTful APIs for cross-system data exchange and automation.
- Collaborate with the BI team to ensure clean, high-quality, and accessible data for the Power BI platform.
- Support semantic modeling, metric layer design, and data governance best practices.
- Enable advanced analytics by provisioning data for ML/AI initiatives and predictive insights.
- Collaborate with product/system owners, analysts, and business stakeholders to translate analytical requirements into technical data solutions.
- Drive best practices in Agile development, version control, and DevOps workflows.

Benefits

Benefits of working at Allucent include:
- Comprehensive be

📌 Data Developer (Bengaluru)
🏢 Allucent
📍 Bengaluru