10 Aug
|
Nameless
|
Jaipur
Job Summary:
We are looking for a highly skilled and motivated GCP Data Engineer to join our team immediately. This is a remote opportunity to support a key client in the retail industry.
The ideal candidate will have hands -on experience in Google Cloud Platform (GCP), Azure Data bricks, and DBT (Data Build Tool). You will work with large -scale structured and unstructured datasets, including retail offline (store sales) and online (e -commerce) data, as well as PII -sensitive information.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines on GCP.
- Work with Azure Data bricks to support data processing and ML workflows.
- Build and manage DBT models for data transformation, quality checks, and reporting.
- Handle structured and unstructured data using modern cloud data stack technologies.
- Implement secure coding practices and ensure compliance with data privacy standards (PII handling).
- Collaborate with data scientists to product ionize machine learning models.
- Integrate and analyze data from various retail sources (in -store POS and e -commerce platforms).
- Monitor and optimize data workflows for performance, scalability, and cost efficiency.
- Work closely with cross -functional teams to deliver robust and reliable data solutions.
Requirements
Required Skills & Qualifications:
- 5+ years of experience in data engineering or related roles.
- Robust expertise in Google Cloud Platform (GCP) data services (BigQuery, Data flow, Pub/Sub, Cloud Functions).
- Experience working with Azure Data bricks for data processing.
- Hands -on experience with DBT (Data Build Tool) in production environments.
- Proficiency in Python and SQL for data processing and ETL pipelines.
- Experience with data orchestration tools (Airflow, Cloud Composer).
- Knowledge of secure coding practices and handling PII data.
- Experience working with unstructured data (logs, media, text, etc.).
- Understanding of retail datasets (offline and online channels).
- Familiarity with data science concepts and supporting ML model product ionization.
- Excellent communication and collaboration skills
- Experience working with international clients, especially Australian clients.
- GCP Professional Data Engineer certification is a plus.
- Familiarity with BigQuery, Data flow, Pub/Sub, Cloud Functions, etc.
- Knowledge of Airflow/Cloud Composer for workflow orchestration.