16 Aug
|
Sciens Software Technologies
|
Hyderabad
16 Aug
Sciens Software Technologies
Hyderabad
Position: Databricks & Azure Synapse / MS Fabric Data Engineer Senior Consultant
Experience: Minimum 6 to 8 Years
Role
Looking for a skilled Databricks / Azure Synapse / MS Fabric Senior Data Engineer with at least 6 to 8 years of experience to join our vibrant team. The ideal candidate should have robust background in Azure data services, including Databricks, Synapse Analytics, Microsoft Fabric, PySpark and SQL. He/She will be responsible for designing, building, and maintaining scalable metadata driven data pipeline solutions that meet business requirements and align with industry best practices.
What is expected out of you?
- At least 6 years of experience as a Databricks & Data Engineer, with demonstrated experience designing and implementing data solutions using Azure services such as Azure Data Factory, Synapse Pipelines, Data Flows, Azure SQL Database, Azure Databricks, Azure Cosmos DB, and Microsoft Fabric Lakehouse / Warehouse solutions.
- Strong experience with Python programming and have a good understanding of relational database concepts.
- Proficient in SQL and experience with Dimensional data modeling, Data warehousing, and ETL processes.
- Develop and optimize data pipelines using Azure Databricks and Synapse Pipelines, ensuring efficient processing of large-scale datasets.
- Utilize Apache Spark on Databricks to perform real-time and batch data processing, enabling robust and scalable data analytics.
- Integrate diverse data sources into Fabric One-Lake / Databricks Lakehouse / Azure Data Lake Storage using Azure Data Factory and Data Flows, ensuring data is readily available for analysis.
- Architect and maintain data solutions with Delta Lake on Databricks or Delta tables in Fabric One Lake, ensuring high data quality, consistency, and accessibility.
- Implement and manage Lakehouse architecture to unify data warehousing and big data analytics on a single platform.
- Leverage Microsoft Fabric to streamline data integration and transformation,
📌 MS Fabric Data Engineer (Hyderabad)
🏢 Sciens Software Technologies
📍 Hyderabad