Job Title: Senior Data Engineer (Azure/SSIS)
Location: PAN INDIA
Experience Range: 7-14 years.
Required Skillset:
Minimum 6 yrs of experience in building ETL pipeline using Azure data Factory, Azure Synapse
Minimum 6 yrs of ETL development using PL/SQL
Exposure in Azure data brick is added advantage
Above average communication skill
should be willing to work as an individual contributor and experience of managing client delivery independently.
Job Description
Must-Have:
Significant experience in Software Development and Agile Methodologies.
Excellent experience in developing ETL routines, processes and structures.
Expert in SSIS and Azure Synapse ETL development.
Significant experience in developing Python or pySpark.
Proven ability to set up Azure Synapse connectors (On-prem file shares, SFTP, SQL database, HTTP, etc..) in real world enterprise environment.
Significant experience in Database and Data Storage Platforms including Azure Data Lake.
Excellent experience in developing ETL routines, processes and structures.
Extensive knowledge of data modelling techniques and structures.
Practical experience of developing ETLs for Dimensions and Fact Tables including SCD I and II implementation.
Excellent experience of deploying solutions in a quick-moving enterprise.
Ability to validate engineering data and deploy solutions. Experience in incident, change management and transition processes
Creating data catalogues
Identifying Critical Data Elements
Recording data quality business rules
Carrying our data quality assessments
Creating data quality assessment scripts & ETLs
Creating data quality reports
Designing & implementing Conceptual, Logical, and Physical data models
Designing & implementing Relational data models with normalisation
Designing & implementing Dimensional Data Models (Dimensions, Facts, SCD I, SCD II, SCD III)
Designing & implementing Lakehouse and Delta Lake architectures
Reporting, documentation/writing.
Excellent Organisational