Apply on Kit Job: kitjob.in/job/43b2wv

Position: Data Engineer

Hiring Type: Long Term Contract

Location: Remote, India

Time: Canada Time Zone (Night Shift from India)

Job Description:

PROJECT OVERVIEW

We are hiring for one of our Canada based client who is undertaking a multi-year Data Mapping and DataOps Platform initiative to modernize its data infrastructure and enable the organization to treat data as a strategic asset.

TECHNICAL REQUIREMENTS

Mandatory Skills

Python

SQL

Git

Microsoft Azure

Microsoft Fabric

ELT Pipeline Development

Data Analysis

Agile Methodologies

Metadata Management

Data Product Design

Preferred Skills

Data Visualization tools

RESTful API Development

Experience in regulated environments

This project focuses on:

Establishing scalable and governed data pipelines

Enhancing data accessibility for analytics and reporting

Implementing a centralized data catalogue

Leveraging Microsoft Azure and Microsoft Fabric for cloud-based data operations

The candidate will play a critical role in advancing the platform from minimum viable product (MVP) to a production-ready, enterprise-grade solution.

OBJECTIVES

Short-Term Objectives

Onboard critical systems into the Finance Data Catalogue (FDC)

Enhance existing data pipelines for stability, traceability, and performance

Capture structured metadata across key domains

Long-Term Objectives

Develop scalable,



cloud-based data architecture

Support enterprise-wide data governance and compliance

Enable advanced analytics and reporting capabilities

Drive adoption of contemporary data services

RESOURCE REQUIREMENTS

Candidate must have recent (within last 48 months) production experience in:

Python

Git

Microsoft Azure

Microsoft Fabric

SCOPE OF WORK

Data Engineering & Pipeline Development

Design, build, and optimize ELT/ETL pipeline

Improve pipeline stability, traceability, scalability, and refresh frequency

Implement orchestration and automation frameworks

Data Mapping & Metadata Management

Capture and structure metadata for enterprise data assets

Onboard critical systems into the Finance Data Catalogue (FDC)

Support data lineage and governance requirements

Data Modelling & Analytics Enablement

Design data models for reporting and analytics

Enable downstream consumption for business intelligence tools

Support analytics solutions

DevOps & Automation

Develop and maintain CI/CD pipelines

Implement automated testing and deployment processes

Develop scripts using Python, Bash, and PowerShell

Data Quality & Monitoring

Implement validation frameworks and data quality checks

Monitor pipeline performance and reliability

Configure alerting and logging systems

Apply on Kit Job: kitjob.in/job/43b2wv

📌 Data Engineer - Data Mapping and DataOps (Nellore)
🏢 STASX Consulting
📍 Nellore