Description
Missions

- Job description:

Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

Today we manage SG Data platform service offers and data tools:

· Data ingestion: to ingest the data from a data source

· Data processing: to process, transform and distribute the data to the target location

· Data exposition : to distribute and expose the data hosted in the data platform

· Data cleaning: to purge the data on the Lake in a secure way

· Data tools: data formatter, data anonymizer

As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile

- Experience: 3-5 Years
- Skills:

- Computer programming:



Spark, Scala, Java, Python

- Operating system knowledge for Unix, Linux

- Databases and SQL

- ETL and data warehousing

- Hadoop

- Apach Spark

Tasks:

· Maintain an excellent service level of the platform and avoid issues.

· Researching new methods of obtaining valuable data and improving its quality

· Creating and enhancing data solutions using various programming languages and tools

· Creating and enhancing data architectures that meet the requirements of the business

· Communicate inside if the tech league group to find recent approaches

📌 Lead Data Engineer - Data Archival - Bangalore (India)
🏢 Photon Group
📍 India