19 Nov
|
Vision Group Retail
|
Noida
19 Nov
Vision Group Retail
Noida
Junior Data Engineer - Azure / Microsoft Fabric
About the Role
Vision Group (VG) is looking for a Junior Data Engineer to join our Big Data & Analytics team. You will build and support the data pipelines that bring in, clean and model data from several sources on Microsoft Fabric and Azure. That data feeds the reports and analytics our business and clients use. This is a hands-on role, working closely with senior engineers and the Power BI / analytics team.
Our platform uses four Azure tools, and you will work across all of them:
- Azure Synapse Analytics: our main data warehouse.
- Azure Data Factory: our data export processes.
- Microsoft Fabric: new DWH - where we will onboard new clients.
- Azure Databricks: ad-hoc processing and one full project.
Experience
- 2-3 years of hands-on experience in data engineering, ETL/ELT development or a similar data role.
Key Responsibilities
- Build, schedule and monitor data pipelines that bring data from files, databases and APIs into the lakehouse.
- Write PySpark notebooks to clean, transform and enrich data across layers (raw → stage → curated).
- Write and tune SQL queries, views and transformations for reporting and analytics.
- Build and maintain workflows in Azure Data Factory / Fabric Data Pipelines (activities, parameters, triggers, alerts).
- Apply data-quality checks, handle failures and troubleshoot pipeline issues.
- Follow team standards for naming, layering, logging and documentation.
- Use Git (Azure DevOps): feature branches, pull requests and code reviews.
- Work with the Power BI and analytics teams to deliver reliable, well-documented datasets.
Required Skills
- SQL: joins, aggregations,
window functions, CTEs and basic performance tuning.
- PySpark: DataFrames, transformations, joins, aggregations, reading and writing Parquet/Delta.
- Spark architecture: driver, executors and cluster manager; jobs, stages and tasks; lazy evaluation; transformations vs actions; partitions and shuffles; narrow vs wide transformations; basics of caching, broadcast joins and data skew.
- Azure data tools: basic working knowledge of all four: Azure Synapse Analytics, Azure Data Factory, Microsoft Fabric and Azure Databricks.
- End-to-end delivery: has built at least one end-to-end data solution (ingestion → transformation → reporting-ready output) on any one of these tools.
- AI-assisted development: basic experience using AI coding tools (e.g. GitHub Copilot, ChatGPT, Claude) to write, debug and document code, and the habit of reviewing and testing AI-generated code before using it.
- Data warehousing: fact/dimension modelling, incremental loads, basic slowly changing dimensions.
- Familiarity with Delta Lake / lakehouse concepts and ADLS Gen2.
- Basic Python and Git.
Positive to Have
- Deeper hands-on experience in more than one of Synapse, ADF, Fabric (Lakehouse, Notebooks, Data Pipelines) or Databricks.
- Exposure to Power BI semantic models.
- Azure Key Vault and secure handling of credentials.
- Certifications such as DP-600, DP-700 or DP-203.
Soft Skills
- Clear written and verbal communication.
- Eager to learn and open to code-review feedback.
- Attention to detail and ownership of data quality.
Education
- Bachelor's degree in Computer Science, IT, Engineering or a related field, or equivalent practical experience.
📌 Data Engineer (Noida)
🏢 Vision Group Retail
📍 Noida