13 Aug
|
Msmp Technologies
|
India
13 Aug
Msmp Technologies
India
Job Summary
Azure Data Engineer Azure Cloud, Services, Databricks, ADT, Python/Pyspark, SQL, SSIS, Healthcare Azure Automation Tech Lead Requirements: Azure, ADT, .NET core, Python/Pyspark, SSIS, SQL Healthcare Domain Experience required Position Overview We are seeking a skilled Azure Databricks Tech Lead to join our agile team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering and analytics initiatives. You will collaborate closely with cross-functional teams to understand business requirements, design scalable data solutions, and lead the execution of projects. Position will require knowledge and experience in the healthcare domain.
Key Responsibilities
- Participate and provide technical leadership in all phases of BI projects
- Technical Leadership: Lead the design, development, and implementation of Azure and .NET core solutions ensuring alignment with business objectives and best practices.
- Architecture and Design:
Architect robust and scalable data pipelines on Azure Databricks
- Data Engineering: Develop ETL processes, data ingestion pipelines, and data transformations to support data integration and analytics requirements.
- Design and implemented real-time data integration pipeline to process semistructured data, across multiple DBMS. RDBMS and NoSQL using Kafka and PySpark
- Implement and design web and data solutions that use the following Azure services: Azure function App, Azure queue Azure ,Web App, Azure storage, Azure Cosmos DB, Azure Data Factory.
- Excellent knowledge of Python, PySpark, SQL/SSIS, C# etc.
- Performance Optimization: Optimize Azure Databricks workloads for performance, reliability, and cost-efficiency, utilizing techniques such as partitioning, caching, and resource management.
- Collaboration: Collaborate with data scientists, analysts, and business stakeholders to understand requirements, translate them int
📌 Azure Data Engineer (India)
🏢 Msmp Technologies
📍 India