About the Role/Project The role involves maintaining and developing data pipelines, serverless migration, and CI/CD process ownership. The solution product line encompasses several key areas, including marketing analytics, category optimisation, pricing optimisation, customer experience improvement, and sales performance enhancement.
Key Responsibilities
- Adapt existing pipelines and code for serverless environments, ensuring stable execution
- Maintain and enhance CI/CD processes, including proposing architectural improvements
- Monitor pipelines and repositories, review merge requests, and oversee code changes
- Develop and maintain data pipelines while understanding underlying business logic
Required Skills & Qualifications
- 8 years of experience in Data Engineering
- Strong experience with Databricks
- Robust experience with PySpark
- Strong experience with SQL
- Hands-on experience with CI/CD pipelines
- Experience with GitHub Actions or similar tools
- Ability to work independently and take ownership of processes
- Experience with serverless architectures
- Understanding of pricing or financial data domains
Preferred / Good to Have Experience with cascading formula-based financial calculations
Familiarity with enterprise client support workflows