11 Sep
|
Coforge
|
Hyderabad
We are seeking a Senior Data Engineer with 6-10 years of experience in building scalable cloud data solutions using Microsoft Fabric, Azure, Spark, SQL, and Python.
Key Responsibilities
- Design and develop ETL/ELT pipelines using Microsoft Fabric Data Factory, Spark, and SQL.
- Build and maintain Lakehouse and Data Warehouse solutions in Fabric.
- Develop batch and streaming data pipelines using Kafka/Event Hub.
- Implement data modeling, transformation, and data quality processes.
- Optimize pipeline performance, scalability, and cost efficiency.
- Support data governance initiatives using Microsoft Purview.
- Implement CI/CD, Git integration, and DataOps best practices.
- Collaborate with architects, analysts, and business stakeholders to deliver data solutions.
Required Skills
- Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse, OneLake)
- SQL, Python, Spark/PySpark
- Azure Data Factory, Synapse, or Databricks
- Delta Lake, Data Warehousing, ETL/ELT
- Kafka/Event Hub, APIs, JSON, Parquet
- CI/CD, Git, DataOps
📌 Senior Data Engineer (Microsoft Fabric & Azure Data Platform) (Hyderabad)
🏢 Coforge
📍 Hyderabad