Role & responsibilities
Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation
Design, code, unit test, and code review iterative improvements to platform
Ensure adherence to sound architecture
Build and maintain the Infrastructure for data products, including data pipelines, storage systems, and processing engines.
Ensures the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime.
Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.
Must-Have :
Min 6+ years experience in implementing projects in Azure stacks
Experience with Azure Databricks, Data Factory
Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
Experience in Python PySpark.
Experience in data ingestion, curation and transformation using spark