- Should have experience in Big Query, Pub/ Sub, Dataflow, Composer DAGs and Air flow
- Robust SQL knowledge – able to translate complex scenarios into queries
- Experience with Data modeling and mapping.
- Experience with Google Cloud SDK & API Scripting
- Strong Programming experience in Python
- Experience in Agile processes and DevOps methodologies.
- Experience of Retail domain will be an added advantage
Responsibility of / Expectations from the Role
- Create and maintain optimal data pipeline architecture replicating the existing process.
- Analyze, explore and select the appropriate tools for data migration and transformation.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Keep data separated and secured using masking and encryption.
- Work with data and analytics experts to strive for greater functionality in data systems.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.