The role involves maintaining and developing data pipelines, serverless migration, and CI/CD process ownership. The solution product line encompasses several key areas, including marketing analytics, category optimisation, pricing optimisation, customer experience improvement, and sales performance enhancement.
Key Responsibilities :
- Adapt existing pipelines and code for serverless environments, ensuring stable execution.
- Maintain and enhance CI/CD processes, including proposing architectural improvements.
- Monitor pipelines and repositories, review merge requests, and oversee code changes.
- Develop and maintain data pipelines while understanding underlying business logic.
Required Skills & Qualifications:
- 8 years of experience in Data Engineering.
- Strong experience with Databricks.
- Strong experience with PySpark.
- Strong experience with SQL.
- Hands-on experience with CI/CD pipelines.
- Experience with GitHub Actions or similar tools.
- Ability to work independently and take ownership of processes.
- Experience with serverless architectures.
- Understanding of pricing or financial data domains.
Preferred / Good to Have:
- Experience with cascading formula-based financial calculations.
- Familiarity with enterprise client support workflows.