- Design, develop, and maintain large-scale data pipelines using Azure Databricks to extract insights from structured and unstructured data sources.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Synapse Analytics.
- Ensure high-quality delivery of projects by testing, debugging, and deploying code on time.
Job Requirements :
- 10-15 years of experience in IT services & consulting industry as a Data Engineer or similar role.
- Robust expertise in Azure Databricks, PySpark, and SQL programming languages.
- Experience working with big data technologies such as Hadoop ecosystem (HDFS) is required.