21 Aug
|
VNB Consulting Services
|
Bengaluru
21 Aug
VNB Consulting Services
Bengaluru
Location: Work from Office (Bengaluru)
Experience: 3-5 years
About Us:
VNB Consulting Services, headquartered in Current Jersey, is an end-to-end technology solution provider specializing in Apps, Automation, Analytics, and AI. Our mission is to deliver tested technology solutions that enhance existing technology, improve business processes, or develop new solutions.
Role Overview:
We are looking for a motivated Sr/Data Analytics Engineer to join our team and work with Microsoft Fabric to design, develop, and maintain data solutions. The candidate will support building data pipelines, integrate data sources, and enable analytics across the enterprise using Fabric’s unified platform.
Key Responsibilities:
Design, build, and maintain scalable data pipelines using Microsoft Fabric technologies (Dataflow Gen2, Data Pipelines, PySpark notebooks, Spark SQL, and Python).
Develop and optimize ETL/ELT processes using Azure Data Factory, ensuring efficient data extraction, transformation, and loading between source systems and D365.
Execute data ingestion, transformation,
and loading for both structured and unstructured data from diverse sources.
Perform data transformations, cleaning, and validation to ensure high data quality.
Write and optimize SQL queries on Azure Synapse Analytics, leveraging both dedicated and serverless resources.
Conduct deep code-level analysis and troubleshooting of Spark core internals, Spark SQL, Structured Streaming, and Delta.
Monitor, troubleshot, and fine-tune data pipelines and workflows to enhance performance, especially with large datasets.
Ensure data governance, security, and compliance with privacy regulations throughout the data engineering lifecycle.
Build and maintain infrastructure for optimal data performance and reliability.
Document processes, workflows, and data models, and provide knowledge transfer/training to team members as needed.
Build reporting and dashboards using tools like Power BI.
Required Skills & Qualifications
SQL and
📌 Sr Data Analytics Engineer (Bengaluru)
🏢 VNB Consulting Services
📍 Bengaluru