Seeking a Specialist with 5 to 7 years of experience in Azure Cloud Architecture and Azure Databricks to design and implement scalable data solutions within the Azure ecosystem
Design develop and optimize endtoend data pipelines using Azure Databricks to support complex data processing and analytics scenarios Architect and maintain secure scalable data storage and processing solutions leveraging Azure Cloud services Collaborate with crossfunctional teams to align data solutions with business objectives and technical requirements Implement best practices for data governance security and compliance within Azure environments Ensure high availability performance and reliability of data platforms through continuous monitoring and tuning Utilize strong expertise in Azure Cloud Architecture to provision and manage Azure resources effectively Apply advanced Databricks concepts including security production architecture and pipeline development Leverage Python and Spark SQL skills for effective data ingestion and transformation workflows
Roles and Responsibilities
Lead design and implementation of Azurebased data integration and processing platforms focusing on Azure Databricks
Mentor and guide data engineers on best practices and technical solutions within Azure Databricks and Azure Cloud
Collaborate with stakeholders to gather requirements and translate them into scalable technical architectures
Oversee data migration transformation and integration activities ensuring seamless data flow
Establish and enforce data architecture standards policies and procedures to maintain data quality and security
Conduct performance tuning troubleshooting and optimization of data pipelines
Manage Azure resource provisioning and configuration aligned with security and compliance standards
Keep abreast of emerging Azure data technologies and tools to drive innovation and improve platform capabilities