- Design, develop, and maintain large-scale data pipelines using Azure Data Bricks to extract insights from various sources.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues.
- Implement machine learning models using Python libraries such as scikit-learn or TensorFlow.
Job Requirements :
- 6-8 years of experience in a similar role as an Azure Data Engineer.
- Solid proficiency in Microsoft Azure services including Databricks, Synapse Analytics, and Stream Analytics.
- Experience working with big data technologies such as PySpark and SQL.