16 Nov
|
HCL Technologies
|
India
16 Nov
HCL Technologies
India
Job Summary
We are looking for Data Engineers,
- Microsoft Fabric experience is mandatory.
- OneLake knowledge is required.
- Medallion Architecture experience (Bronze, Silver, Gold layers) is mandatory.
- Robust experience in PySpark, SQL and data transformation pipelines is required.
- Candidates focused only on Semantic Models or Reporting Layers may not fit this requirement.
Key Responsibilities
Data Engineer (Microsoft Fabric)
- Builds the Bronze, Silver and Gold layers, the reusable framework, and the data quality and reconciliation controls.
Key responsibilities
- Build the metadata-driven ingestion and transformation framework
- Develop Bronze ingestion, Silver cleansing and conformance, and Gold marts
- Implement data quality rules, quarantine handling and reconciliation controls across layers
- Build orchestration, scheduling and dependencies in Fabric pipelines
- Tune performance,
partitioning and capacity use
- Support SIT, parallel run and hypercare, and fix defects
- Write clean, version-controlled, documented code
Required skills and experience
- Data engineering on Spark with PySpark and Spark SQL; Delta Lake
- Hands-on Fabric (Lakehouse, Notebooks, Pipelines) or equivalent Synapse or Databricks experience
- Strong SQL and dimensional modelling basics
- Git and CI/CD practices
- Testing and debugging data pipelines
Skill RequirementsPrimary Skills
- Microsoft Fabric
- PySpark
- SQL
- OneLake
- Delta Lake
- Medallion Architecture
- Data Pipelines
Secondary Skills
- Git
- CI/CD
- DevOps Practices
- Data Quality Frameworks
Other Requirements
📌 Technical Lead (India)
🏢 HCL Technologies
📍 India