Job description :
SOURCERIGHT TECHNOLOGIES (INDIA) PRIVATE LIMITED is looking for Azure Data Engineer to join our energetic team and embark on a rewarding career journey.
- Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
- Solution design using Microsoft Azure services and other tools
- The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
- Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
- Build data pipelines to collectively bring together data
- Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
Mandatory Skill Set :
Python, PySpark, Apache Airflow, Databricks, Azure Data Factory, SQL
- Build data pipelines and data processing jobs using Spark, Apache Airflow, Azure Data Factory and Databricks
- Involve in design and build of data service APIs