13 Aug
|
Topcoder
|
Noida
Data Engineer/Architect – EDGE|ML
Description
EDGE|ML is an end-to-end analytics and solutions platform aiming to supply SCM, logistics, store and category managers with data, insights, and solutions to optimize their processes. EDGE|ML is built on a state-of-the-art, scalable technology leveraging Google Cloud Platform managed services.
The ideal candidate for the Data engineer/architect role is an experienced data pipeline/architecture builder who enjoys building from the ground up and optimizing data systems.
Your challenges
- Augment EDGE|ML offerings by enhancing, extending, optimizing, and operationalizing the analytic services.
- Data Architecture
- Optimally design and work with large, complex datasets in BigQuery.
- Data Engineering
- Design, build, maintain, productionize, and operate data pipelines in GCP using Python, SQL, and Google managed services.
- Deploy machine learning models.
- Collaborate closely with business stakeholders, data analysts/scientists, software engineers, and platform operations staff.
You should bring in
- Data architecture
- 5+ years of experience in Data Warehousing, Business Intelligence, Big Data.
- Advanced working SQL knowledge and experience (CTE, window functions) working with relational databases, as well as working familiarity with a variety of databases.
- Extensive knowledge of data modelling approaches and best practices. Experience in implementation of a data mesh architecture in Google Cloud is a solid plus.
- Extensive knowledge of techniques for query optimization in BigQuery.
- Data Engineering
- 5+ years of experience in a Data Engineering role
- Extensive experience building, optimizing, and productionizing ‘big data’ data pipelines, in Google Cloud Platform.
- Experience designing and deploying high performance systems with reliable monitoring and logging practices.
- Experience with source control systems (GitHub) and continuous integration & deployment tools e.g. Jenkins
- Experience using application
📌 Data Engineer/Architect – EDGE|ML (Noida)
🏢 Topcoder
📍 Noida