Grade:

Position Name: Consultant

Company overview

.

Get to Know the Opportunity

We are seeking a highly skilled and experienced Databricks Engineer to join our growing team and play a crucial role in enhancing our data processing and analytics capabilities.
As a Databricks Engineer you will be responsible for dealing with the most complex situations related to development, design, implementation, and maintenance of our Databricks setting to ensure optimal performance, scalability, and reliability while aligning with our audit and security standards. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers to build robust data pipelines and deliver actionable insights

The Contributions You Will Make

1. Databricks Environment Management:
• Set up and configure Databricks clusters to meet specific project requirements
• Optimize Databricks configurations for performance and cost-effectiveness
• Ensure the security and integrity of the Databricks environment

2. Data Pipeline Development:
• Collaborate with data scientists and analysts to understand data requirements
• Design and implement scalable and efficient data processing pipelines using Databricks




• Troubleshoot and optimize existing data pipelines for improved performance

3. Integration and Collaboration:
• Work closely with cross-functional teams to integrate Databricks solutions into the overall data architecture
• Collaborate with software engineers to incorporate Databricks functionality into custom applications

4. Monitoring and Maintenance:
• Implement robust monitoring and logging solutions for Databricks clusters
• Conduct regular maintenance tasks, including updates and patches, to ensure system stability
• Generate/ review consumption reports, identify abnormal consumption and take corrective action.

5. Documentation and Training:
• Create and maintain comprehensive documentation for Databricks configurations and processes, document best practices and standards to be followed
• Provide training and support to internal teams on using Databricks effectively

Education Qualification

1. Engineering Graduate / BSc in Computer Science / Information Science or Equivalent

Expected Minimum Knowledge & Experience

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's Degree preferred

Other Required Critical Skills

📌 Consultant (India)
🏢 Important Group
📍 India