16 Sep
|
Nihilent
|
Chennai
Experience
- Overall 6+ years of experience in Azure Data Engineering and Data Warehousing.
- At least 2-3 years of hands-on experience with Microsoft Fabric.
Technical Skills
- Strong understanding of Data Warehousing concepts, architecture, and best practices.
- Hands-on experience in designing and implementing Enterprise Data Warehouse (EDW) solutions.
- Good experience in Dimensional Data Modeling using Star and Snowflake schema techniques.
- Strong knowledge of ETL/ELT design and implementation.
- Hands-on experience with Microsoft Fabric components, including:
- Lakehouse
- Data Factory
- Data Pipelines
- Notebooks (PySpark)
- Warehouse
- Semantic Models
- Power BI Reporting (optional)
- Good experience in developing data transformation logic using PySpark and SQL.
- Strong SQL programming and query optimization skills.
- Experience working with Delta Lake tables and Medallion Architecture (Bronze, Silver, Gold).
- Experience with Metadata-Driven ETL/ELT Frameworks.
- Understanding of Incremental Data Loading, CDC (Change Data Capture), and SCD (Slowly Changing Dimensions).
- Experience in data validation, reconciliation, and end-to-end testing.
- Solid understanding of data quality frameworks and validation techniques.
- Experience in performance tuning and optimization of ETL pipelines and SQL queries.
- Ability to troubleshoot and resolve production data issues within SLA timelines.
- Experience in monitoring data pipelines, job failures, and root cause analysis.
Azure & DevOps (Optional )
- Hands-on experience with Azure DevOps for source code management and CI/CD implementation.
- Experience creating and maintaining build and release pipelines.
- Knowledge of Git branching strategies and version control best practices.
- Experience in deployment automation across Development, UAT, and Production environments.
Data Integration
- Experience integrating data from multiple source systems such as SQL Server, Oracle, SAP, REST APIs, and flat files.
- Experience with incremental and full-load data ingestion patterns.
- Knowledge of handling structured and semi-structured data (JSON, XML, CSV, Parquet).
Project Experience
- Hands-on experience in at least one end-to-end Data Warehouse implementation project, from requirements gathering through production deployment and hypercare support.
- Experience participating in solution design, technical discussions, and architecture reviews.
- Ability to estimate development effort and prepare technical design documents.
Soft Skills
- Strong analytical and problem-solving skills.
- Excellent debugging and troubleshooting abilities.
- Good communication and stakeholder management skills.
- Ability to work independently and collaboratively within Agile/Scrum teams.
- Willingness to mentor junior team members and participate in knowledge-sharing sessions.
Preferred Skills
- Microsoft Fabric Certification (DP-700 or equivalent) is preferred.
- Knowledge of Power BI and Semantic Models.
- Exposure to Azure Data Factory, Azure Synapse Analytics, or Databricks/PySpark is mandatory .
- Experience working in Retail, Manufacturing, or Financial Services domains is desirable
📌 Senior Data Engineer- MS Fabric (Chennai)
🏢 Nihilent
📍 Chennai