22 Aug
|
Tekskills
|
Pune
Architect and deploy scalable Databricks solutions on Azure.
- Develop and implement data pipelines, ETL processes, and machine learning workflows using Databricks and Azure services.
- Monitor Databricks performance and optimize configurations for efficiency and cost-effectiveness.
- Implement best practices for data storage, processing, and analysis to ensure optimal performance.
- Ensure Databricks environments comply with security standards and regulatory requirements.
- Implement and manage data encryption, access controls, and other security measures.
- Perform regular maintenance tasks, including updates, patches, and backups.
- Provide advanced technical support for Databricks-related issues and act as the escalation point for complex problems.
- Collaborate with data engineers, data scientists, and analysts to design and optimize data workflows.
- Work with IT and DevOps teams to integrate Databricks with other Azure services and tools.
- Develop and deliver training sessions for internal teams on Databricks best practices and new features.
- Document architectures, configurations, and procedures for knowledge sharing and future reference.
To be successful in this role, you should meet the following requirements:
- Strong analytical and problem-solving skills.
- Strong technical documentation capabilities.
- Agile framework and delivery lifecycle management.
- Team based development capabilities and ability to manage personal deliverables.
- Experience with multi-cloud environments and hybrid cloud strategies.
- Familiarity with DevOps practices and tools such as Azure DevOps, Jenkins, or GitHub Actions and Azure DevOps
- Databricks Certified Associate Developer or equivalent certification.
- Relevant Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect
- In-depth knowledge of Databricks architecture, Spark, and Delta Lake.
- Proficiency in managing and optimizing Databricks clusters and jobs.
- Experience with deploying and managing Databricks on Azure, including integration with Azure Data Lake, Azure SQL Database, and other Azure services.
- Solid programming skills in languages such as Python, SQL, and Scala.
- Familiarity with data warehousing concepts and ETL processes.
- Strong understanding of Azure infrastructure and services, such as Azure Virtual Machines, Azure Storage, and Azure Networking.
- Azure Database and data platform
- Database Services, including Azure SQL and Cosmos DB
- Monitoring, Diagnostics, and Analytics with Azure Monitor
- Azure Data Factory and Data Pipeline Orchestration
- Azure Synapse Analytics and Data Warehousing
- Data Modeling and Database Design
- Power BI and Data Visualization
- MongoDB Experience a plus
📌 Opening For Azure data engineer (Pune)
🏢 Tekskills
📍 Pune