19 Sep
|
Acuity Knowledge Partners
|
Bengaluru
19 Sep
Acuity Knowledge Partners
Bengaluru
Job purpose
We are seeking a highly skilled Microsoft Fabric Data Engineer to design, develop, and optimize modern cloud-based data platforms using Microsoft Fabric. The ideal candidate will have strong expertise in data engineering, analytics, and data integration, with hands-on experience in building scalable data pipelines, Lakehouse architectures, and enterprise-grade data solutions leveraging Microsoft Fabric and Azure services.
The candidate will work closely with business stakeholders, data analysts, data scientists, and solution architects to deliver high-quality data products that support reporting, analytics, AI, and business decision-making.
Key responsibilities
- Design, develop, and maintain scalable data pipelines using Microsoft Fabric.
- Build and manage Lakehouse architectures utilizing OneLake as the enterprise data foundation.
- Develop ETL/ELT data ingestion frameworks from multiple structured and unstructured data sources.
- Create and optimize data workflows using Fabric Data Factory and Fabric Data Engineering capabilities.
- Develop and maintain data models, semantic models, and analytical datasets.
- Implement data transformation logic using PySpark, Spark SQL, SQL, and notebooks.
- Design and optimize Data Warehouses within Microsoft Fabric.
- Monitor, troubleshoot, and improve performance of data pipelines and analytics workloads.
- Ensure data quality, governance, security, and compliance standards are maintained.
- Collaborate with business users to translate requirements into scalable technical solutions.
- Support Power BI reporting and self-service analytics initiatives.
- Implement CI/CD practices and automate deployment of Fabric assets.
- Participate in architecture reviews, code reviews, and technical design discussions.
Key competencies
Required Skills
- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.
- Solid understanding of modern data platform architecture and cloud-native analytics solutions.
- Proven experience building enterprise-scale data pipelines and analytics platforms.
- Experience working in Agile development environments.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management.
- Ability to work independently and in cross-functional teams.
- Strong focus on data quality, scalability, and operational excellence.
- Continuous learning mindset with a passion for emerging data technologies.
- Core Skills:
o Microsoft Fabric (Lakehouse, Data Factory, Warehouse, OneLake) o SQL, Python, PySpark o Data Warehousing & Data Modeling o Power BI & Analytics o Azure Data Platform o ETL/ELT Development o CI/CD & DevOps o Data Governance & Data Quality
Nice to have Skills:
- Databricks
- Delta Lake
- Medallion Architecture
- Azure Synapse
- Real-Time Analytics
- Purview
- AI/ML & Generative AI
- Terraform/Bicep
- Streaming Data Solutions
Job Snapshot
Job ID
JOB_8473
Department
Data and Technology Services
Location
ETV -SEZ1, Bengaluru, Karnataka, India ..+ 1
Experience
6 - 9 Years
Employee Type
Permanent
📌 Delivery Lead-Microsoft Fabric Data Engineer (Bengaluru)
🏢 Acuity Knowledge Partners
📍 Bengaluru