Skill Sets
- Develop, Enhance SQL, Pyspark
- Create, Enhance SQL Store Procedures
- Design and propose technical solution
- Design criteria and test cases for unit testing;
- perform unit testing and document results.
- Provide technical support to functional consultants.
- Develop technical design, follow defined process for timely completion of high-quality deliverables
- Understand & support requirements and estimate for assigned work
Knowhow on tools
- Azure Cloud Azure ADLS MS SQL Server Azure Databricks MS SQL Management studio
Knowhow on methodologies
- DevOps Agile way of working
Expected deliverables
- Must be aware of interaction of ETL in Azure and Databricks / Spark
- Designing and developing complex data transformations using Pyspark
- Designing and developing moderately complex database entities Demonstrated intermediate level of competency with Azure SQL Database, Azure SQL Managed Instance and SQL scripting.
- Demonstrated experience with Azure: Data Lake Gen 2, Key Vault and Dev Test Labs
- Aware of DevOps CICD pipelines for Spark /Databricks