This role will be responsible for creating Data orchestration with Azure Data Factory Pipelines, Pyspark, Python, SQL & Dataflows.
Job Responsibilities
Understand business requirement and actively provide inputs from Data perspective
Understand the underlying data and flow of data
Build simple to complex pipelines & dataflows
Work with other Azure stack modules like Azure Data Lakes, SQL DW,
Should be able to implement modules that has security and authorization frameworks
Recognize and adapt to the changes in processes as the project evolves in size and function Knowledge, Skills & Abilities:
Expert level knowledge on Azure Data Factory, Databricks, Pyspark
Expert level knowledge of SQL, SQL DB & Datawarehouse
Should know at least one programming language
Should be able to analyze and understand complex data
Knowledge of Azure data lake is required
Knowledge of other Azure Services like Analysis Service, SQL Databases will be an added advantage
Excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision
Education
BE/B.Tech
Master of Computer Application
Work Experience
Overall, 4-6 years of rich experience in the Pharmaceutical / Life Sciences Domain.
Expert level knowledge on Azure Data Factory, Databricks, Pyspark
Expert level knowledge of SQL, SQL DB & Datawarehouse
Independently he/she should be able to create data pipeline design, implement, deliver complex data pipeline code for straightforward to complex Data Integration/ Data Warehousing project assignments.
Other than Azure Data Services Stack