Azure Data Engineer(Python, PySpark, Databricks, ADF)
The successful candidate will be responsible for
- Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage efficiently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.
- Design, build,
and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage effeciently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.