15 Nov
|
Acesoft Labs
|
Bengaluru
15 Nov
Acesoft Labs
Bengaluru
Immediate Joiners are preferred
Data Engineer (Azure Fabric & Databricks)
Job Summary
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will play a crucial role in our data ecosystem by leveraging cloud technologies to improve data accessibility, quality, and business insights across the organization. This role requires hands-on expertise in Microsoft Fabric and Azure Databricks.
Required Qualifications
- Bachelors degree in Computer Science, Data Engineering, Information Technology, or a related field.
- Strong proficiency in Microsoft Fabric and Azure Databricks for data processing, transformation, and pipeline orchestration.
- Solid SQL skills with a solid understanding of data modeling concepts and best practices.
- Experience troubleshooting, optimizing, and maintaining data workflows and pipelines.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
Key Responsibilities:
Data Pipeline Development
- Design, build, and optimize scalable data pipelines to ingest, transform, and load data from multiple sources using Microsoft Fabric and Azure Databricks.
- Ensure reliable, efficient, and maintainable data integration processes.
Data Architecture
- Develop and manage data models and data structures within Databricks and Fabric environments.
- Ensure efficient data organization, governance, scalability, and accessibility.
Data Transformation
- Implement data transformation processes using DBT and other relevant tools.
- Standardize and prepare data for reporting, analytics, and business intelligence initiatives.
Performance Optimization
- Monitor, troubleshoot, and optimize data pipeline performance.
- Identify bottlenecks and implement solutions to improve efficiency and reliability.
Collaboration
- Work closely with data scientists, business analysts, engineers, and stakeholders to support data-driven initiatives.
- Provide access to reliable, high-quality, and well-structured datasets for business and analytical needs.
Mandatory Skills
- Microsoft Fabric
- Azure Databricks
- SQL
- Data Modeling
- Data Engineering
- ETL / ELT Development
- Data Pipeline Optimization
Preferred Skills
- DBT (Data Build Tool)
- Data Warehousing
- Azure Data Services
- Data Governance
- Performance Tuning
Experience
- Relevant experience in Data Engineering with hands-on expertise in Microsoft Fabric and Azure Databricks.
- Experience designing and supporting enterprise-scale data pipelines and analytics platforms.
📌 Data Engineer (Bengaluru)
🏢 Acesoft Labs
📍 Bengaluru