Role Summary
This role is a excellent fit for an experienced Azure Databricks Developer who thrives in data engineering and analytics. You will play a crucial part in designing and building scalable data solutions using Azure Databricks and PySpark.
Responsibilities
Design, develop, and maintain data pipelines utilizing Azure Databricks and PySpark to meet project needs.
Collaborate with data scientists and analysts to gather data requirements and produce robust data solutions.
Optimize existing data workflows, focusing on enhancing performance and scalability.
Monitor, troubleshoot, and resolve issues within data pipelines to ensure consistent reliability and efficiency.
Keep abreast of the latest advancements in data engineering practices as well as updates in Azure services.
Must-Have Skills
Robust expertise in Azure Databricks and proficiency in using PySpark.
In-depth understanding of ETL processes and data processing methodologies.
Experience in data modeling techniques and database design principles.
Familiarity with cloud computing concepts and various data storage options.
Excellent analytical skills paired with meticulous attention to detail.
Positive-to-Have Skills
Knowledge of machine learning concepts or frameworks can be beneficial.
Experience working with large datasets across different platforms may enhance your profile.
Familiarity with other programming languages related to data processing.
Take the next step in your career by applying for this position where you can contribute significantly to our data initiatives.