We are currently hiring for a Senior Data Engineer / Azure Databricks opportunity. Please find the requirement details below:
Role: Senior Data Engineer / Azure Databricks Engineer
Experience: 8+ Years
Primary Skills: Databricks, Azure, Data Engineering, Python
Technology: Microsoft Azure / Databricks / Azure Data Lake / Microsoft Fabric
Key Responsibilities
- Design, implement, and manage scalable data solutions on Microsoft Azure.
- Develop and maintain robust data pipelines using Databricks.
- Implement productive data storage and retrieval using Azure Storage and Azure Data Lake.
- Automate infrastructure and application deployments using Ansible and YAML.
- Develop clean, scalable, and maintainable code using Python.
- Use Git and GitLab for version control and CI/CD.
- Gather and document business requirements through stakeholder discussions and workshops.
- Analyze business requirements and translate them into technical specifications.
- Apply data analytics to interpret data and support data-driven business decisions.
- Collaborate effectively with stakeholders and provide regular project updates.
- Identify opportunities for process improvement and automation.
- Support and mentor junior team members and contribute to wider engineering initiatives.
Essential Skills
- 8+ years of experience in Data Engineering / Data Analysis.
- Strong hands-on experience with Microsoft Azure.
- Hands-on experience with Azure Databricks for data processing and analytics.
- Strong understanding of Azure Storage and Azure Data Lake.
- Knowledge of Microsoft Fabric concepts and best practices.
- Experience designing and implementing Azure Data Lakes.
- Hands-on experience with Ansible and YAML for automation/configuration management.
- Strong programming skills in Python.
- Strong experience with Git and GitLab CI/CD.
- Excellent stakeholder communication and analytical skills.