Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
Manage efficiently large dataset.
Manage SQL database - Postgresql or MongoDB.
Implement and maintain complex data calculation formula.
Open to collaborate with Software Engineers.
Participate in code reviews, design discussions, and software planning.
Contribute to automation, testing, and deployment processes. Key Responsibilities*
Design, build,
and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python. Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
Manage effeciently large dataset.
Manage SQL database - Postgresql or MongoDB.
Implement and maintain complex data calculation formula.
Open to collaborate with Software Engineers.
Participate in code reviews, design discussions, and software planning. Contribute to automation, testing, and deployment processes.