13 Oct
|
VDart Software Services
|
India
13 Oct
VDart Software Services
India
Position :- Fabric Data Engineer
Experience :- 6 10 Years Relevant in Azure Data Engineer
Shift Timing :- 02:00 PM IST to 11:00 PM IST
Must HAVE SKILS :: Non-Negotiables
- Minimum 6 Years Relevant Azure Data Engineering components - Pyspark, SQL, Azure Data Factory, Azure data services (ALL MUST )
- Must have experience with Azure Synapse Analytics or Microsoft Fabric (minimum 2+ Year)
- Should be able to work independently with minimum supervision & contribute to the team with hands on development.
Microsoft Fabric Data Engineer - Required Technical Skills
- Microsoft Azure Data Engineer to join our growing Data & Analytics Team
- Migrate Pipeline migration using PySpark/SQL
- The ideal candidate will have strong hands-on experience with Microsoft Azure data services, Azure Synapse Analytics and/or Microsoft Fabric, data engineering, data integration, data transformation, and enterprise data platforms.
- The Microsoft Azure Data Engineer will be responsible for designing, developing, implementing, and optimizing scalable data pipelines, data warehouses, Lakehouses, and enterprise data solutions using the Microsoft Azure data ecosystem.
- Candidates should have significant experience working with Azure Synapse Analytics or Microsoft Fabric, with experience across both platforms considered highly desirable.
- This role will work closely with data architects, Power BI developers, analysts, software engineers, Dev Ops engineers, and business stakeholders to build reliable, scalable, secure, and high-performing enterprise data platforms.
KEY RESPONSIBILITIES
Azure Data Engineering
- Design, develop, and maintain enterprise data solutions using Microsoft Azure.
- Build scalable data ingestion, transformation, and processing solutions.
- Develop and optimize data pipelines using Azure Data Factory, Azure Synapse Analytics, and/or Microsoft Fabric.
- Design solutions that integrate data from databases, APIs, files, SaaS platforms, cloud applications, and enterprise systems.
- Develop reusable data engineering frameworks and components.
- Implement batch and near-real-time data processing solutions.
- Monitor, troubleshoot, and optimize Azure data workloads.
- Support modernization and migration of legacy data platforms to Azure.
Azure Synapse Analytics & Microsoft Fabric
- Design and develop data solutions using Azure Synapse Analytics and/or Microsoft Fabric.
- Build enterprise data warehouses and Lakehouse solutions.
- Develop data pipelines and orchestration workflows.
- Work with Synapse Pipelines, Fabric Data Factory, and Azure Data Factory.
- Develop notebooks using Python, PySpark, and Spark SQL.
- Build and optimize data transformation processes.
- Work with Synapse SQL, Fabric Data Warehouse, Fabric Lakehouse, and related technologies.
- Support migration and modernization initiatives between traditional Azure architectures, Azure Synapse, and Microsoft Fabric.
- Evaluate appropriate technologies based on performance, scalability, cost, security, and business requirements.
ETL/ELT & Data Integration
- Design and develop robust ETL and ELT pipelines.
- Ingest structured, semi-structured, and unstructured data from multiple enterprise sources.
- Integrate data from databases, APIs, files, SaaS applications, and cloud platforms.
- Develop reusable ingestion and transformation frameworks.
- Implement incremental data loads and Change Data Capture (CDC) strategies.
- Develop data validation, reconciliation, and error-handling processes.
- Troubleshoot pipeline failures and data integration issues.
- Optimize pipelines for performance, scalability, reliability, and cost.
Data Lake, Lakehouse & Data Warehouse
- Design and implement contemporary Data Lake, Lakehouse, and Data Warehouse architectures.
- Work with Azure Data Lake Storage Gen2 and Microsoft One Lake.
- Implement Bronze, Silver, and Gold data layers.
- Design dimensional data models using Star and Snowflake schemas.
- Develop fact and dimension tables.
- Implement Slowly Changing Dimensions (SCD).
- Work with Delta Lake and related technologies.
- Implement partitioning and performance optimization strategies.
- Support enterprise data warehouse modernization and migration initiatives.
Azure Data Platform
Work with Microsoft Azure technologies including:
- Azure Data Factory
- Azure Synapse Analytics
- Azure Data Lake Storage Gen2
- Azure SQL Database
- Azure SQL Managed Instance
- Azure Functions
- Azure Key Vault
- Azure Event Hubs
- Azure Storage
- Microsoft Entra ID
- Microsoft Fabric
Additional responsibilities include:
- Develop integrations between Azure services and enterprise applications.
- Implement secure and scalable cloud data architectures.
- Support cloud migration and modernization initiatives.
- Monitor Azure resources and optimize platform performance and cost.
- Apply cloud architecture and engineering best practices across data solutions.
Microsoft Fabric - Responsibilities may include:
- Develop solutions using Fabric Lakehouse and Data Warehouse.
- Build pipelines using Fabric Data Factory.
- Develop Dataflows Gen2.
- Work with One Lake.
- Develop Fabric Notebooks using PySpark, Python, and Spark SQL.
- Implement Delta Lake-based data architectures.
- Support Direct Lake and Power BI integration.
- Manage Fabric workspaces and deployment processes.
- Monitor and optimize Fabric capacity utilization.
- Python, PySpark & Data Processing
- Develop scalable data transformations using Python, PySpark, and Spark SQL.
- Process large datasets using distributed computing
VDart: Digital Consulting & Staffing Solutions
VDart is a leading digital consulting and staffing company founded in 2007 and headquartered in Alpharetta, Georgia. VDart is one of the top staffing companies in USA & also provides technology solutions, supporting businesses in their digital transformation journey. Digital consulting services, Digital consulting agency
Core Services:
- Digital consulting and transformation solutions
- Comprehensive staffing services (contract, temporary, permanent placements)
- Talent management and workforce solutions
- Technology implementation services
Key Industries: VDart primarily serves industries such as automotive and mobility, banking and finance, healthcare and life sciences, and energy and utilities. VDart - Products, Competitors, Financials, Employees, Headquarters Locations
Notable Partnership: VDart Digital has been a consistently strong supplier for Toyota since 2017 Digital Transformation Consulting & Strategy Services | VDart Digital, demonstrating their capability in large-scale digital transformation projects.
With over 17 years of experience, VDart combines staffing expertise with technology solutions to help organizations modernize their operations and build skilled workforce capabilities across multiple sectors.
📌 Fabric Data Engineer (India)
🏢 VDart Software Services
📍 India