Role & responsibilities
Lead and mentor junior data engineers
Design, build and deploy ELT pipelines and data management processes.
Operationalise ELT job workflow with reliable error/exception handling and rollback framework.
Build and oversee data architecture & pipelines platforms and systems, managing the flow of data from internal and external sources by leveraging both distributed and local structures.
Participate in developing, designing, configuring, and documenting database architecture.
Monitor and improve data loading performance.
Working with CI/CD pipelines to manage and execute releases
Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project
Conform to agile development practices Evolutionary design, refactoring, continuous integration/delivery, test-driven development.
Work collaboratively with Business Partner Team and Business Stakeholder during projects scoping and feasibility phases as a SME for concept investigation/viability and technical impact; Identify and communicate technical risks and mitigations.
Provide production support for data load jobs.
Write customized query to generate automatic periodic reports.
Maintain or upgrade existing applications.