Key Skills (Mandatory):
- Strong experience in Data Engineering (5–10 years)
- Expertise in Microsoft Fabric (OneLake, Lakehouse, Data Warehouse, Real-Time Analytics)
- Hands-on experience with Azure Data Factory (ADF), Synapse, and Databricks
- Robust proficiency in PySpark, Spark SQL, and Python
- Advanced SQL skills for data transformation and performance tuning
- Experience with ETL/ELT design patterns and large-scale data pipelines
- Experience working with structured and unstructured data within Data Lakes
- Familiarity with CI/CD pipelines and deployment automation (Azure DevOps/Git)
Key Responsibilities:
- Design and develop scalable data pipelines using Microsoft Fabric and Azure services
- Implement data ingestion, transformation, and orchestration workflows
- Build and manage Lakehouse architecture and data models in OneLake
- Optimize data processing using PySpark and distributed computing techniques
- Ensure data quality, governance, and security across pipelines
- Collaborate with business teams, architects, and analysts to gather requirements
- Support real-time and batch data processing use cases
- Implement best practices for performance tuning and cost optimization
- Mentor junior engineers and contribute to capability building