Roles and Responsibilities
Design, develop, test, deploy, and maintain large-scale data processing pipelines using Databricks.
Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
Develop complex SQL queries to extract insights from massive datasets stored in Azure Synapse.
Implement machine learning models using Python libraries such as scikit-learn and TensorFlow.
Troubleshoot issues related to data quality, performance optimization, and scalability.