About the Role

We are seeking a highly skilled and experienced Data Engineer specializing in Databricks and Fabric to join our agile team. In this remote position, you will play a pivotal role in designing and implementing robust data pipelines and data solutions that drive business insights and decision-making. Your expertise will help us leverage Databricks and Fabric to enhance our data processing capabilities, ensuring scalability and performance. If you are passionate about data engineering and are looking to make a significant impact, we encourage you to apply!

Key Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks and Fabric.
Implement data transformation processes that ensure data quality and integrity.
Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions.
Optimize data storage and processing performance for large datasets.
Monitor and troubleshoot data pipeline performance issues, ensuring minimal downtime.




Documentation of data engineering processes and best practices.
Mentor junior data engineers and promote knowledge sharing within the team.

Required Qualifications
Bachelor's degree in Computer Science, Engineering, or a related field.
5+ years of experience in data engineering, with a focus on Databricks and Fabric.
Robust proficiency in SQL, Python, and Spark.
Experience with data modeling and ETL best practices.
Familiarity with cloud data platforms (e.g., Azure, AWS).
Ability to work independently and collaboratively in a remote team workplace.

Preferred Qualifications
Master's degree in a relevant field.
Experience with real-time data processing frameworks.
Knowledge of data governance and compliance standards.
Familiarity with Machine Learning concepts and tools.

Technical Skills Required
Databricks
Microsoft Fabric
Apache Spark
SQL
Python
Data Warehousing
ETL Processes

📌 Data Engineer Databricks & Fabric Remote Pune
🏢 Diacto Technologies
📍 Pune