About the Role

We are seeking a highly skilled Data Engineer – Microsoft Fabric (PySpark) to design, develop, and optimize modern data engineering solutions on the Microsoft Fabric platform. The ideal candidate will have strong expertise in PySpark, Spark SQL, Microsoft Fabric Lakehouse, Data Factory Pipelines, and ETL/ELT development, with the ability to build scalable, high-performance data processing solutions for enterprise analytics.

Key Responsibilities

- Design, develop, and maintain scalable data processing solutions using PySpark within Microsoft Fabric.
- Build, optimize, and manage ETL/ELT pipelines for processing large-scale structured and semi-structured datasets.
- Develop high-performance data transformation workflows using Spark DataFrames and Spark SQL.
- Create and maintain robust data ingestion, transformation, and aggregation pipelines using Fabric Notebooks, Lakehouse, and Data Factory Pipelines.
- Implement best practices for data engineering, including performance tuning, partitioning, caching, and query optimization.
- Design reliable and reusable data models to support business intelligence and advanced analytics initiatives.
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver scalable solutions.
- Monitor pipeline execution, troubleshoot failures, and optimize workloads for reliability and efficiency.
- Ensure data quality, governance, and security standards are followed across all data engineering processes.




- Document technical solutions, workflows, and deployment processes to support operational excellence.

Required Skills & Qualifications

- Strong hands-on experience with Microsoft Fabric and PySpark.
- Expertise in Spark SQL, Spark DataFrames, and distributed data processing.
- Experience building enterprise-grade ETL/ELT pipelines.
- Hands-on experience with Fabric Notebooks, Lakehouse, and Data Factory Pipelines.
- Strong understanding of data ingestion, transformation, aggregation, and orchestration.
- Experience working with structured and semi-structured data (CSV, JSON, Parquet, Delta, etc.).
- Knowledge of data modeling, performance optimization, and data pipeline monitoring.
- Familiarity with Git-based version control and CI/CD practices is preferred.
- Excellent analytical, problem-solving, and communication skills.

Preferred Qualifications

- Experience working with enterprise-scale data platforms and cloud-native analytics solutions.
- Exposure to Azure Data Services and Delta Lake is an advantage.
- Microsoft Fabric or Azure Data Engineering certifications are a plus.

Why Join Applix?

- Work on cutting-edge cloud data engineering projects using Microsoft Fabric.
- Build scalable enterprise data platforms with modern technologies.
- Collaborate with experienced engineering teams on high-impact digital transformation initiatives.
- Opportunity to work in a rapid-paced, innovation-driven environment with continuous learning and career growth.

📌 Data Engineer (Chennai)
🏢 Applix
📍 Chennai