Skill Sets
Develop, Enhance SQL, Pyspark
Create, Enhance SQL Store Procedures
Design and propose technical solution
Design criteria and test cases for unit testing;
perform unit testing and document results.
Provide technical support to functional consultants.
Develop technical design, follow defined process for timely completion of high-quality deliverables
Understand & support requirements and estimate for assigned work
Knowhow on tools
Azure Cloud Azure ADLS MS SQL Server Azure Databricks MS SQL Management studio
Knowhow on methodologies
DevOps Agile way of working
Expected deliverables
Must be aware of interaction of ETL in Azure and Databricks / Spark
Designing and developing complex data transformations using Pyspark
Designing and developing moderately complex database entities Demonstrated intermediate level of competency with Azure SQL Database, Azure SQL Managed Instance and SQL scripting.
Demonstrated experience with Azure: Data Lake Gen 2, Key Vault and Dev Test Labs
Aware of DevOps CICD pipelines for Spark /Databricks