:
Should have experience in Big Query, Pub/ Sub, Dataflow, Composer DAGs and Air flow
Solid SQL knowledge – able to translate complex scenarios into queries
Experience with Data modeling and mapping.
Experience with Google Cloud SDK & API Scripting
Robust Programming experience in Python
Experience in Agile processes and DevOps methodologies.
Experience of Retail domain will be an added advantage
Responsibility of / Expectations from the Role
Create and maintain optimal data pipeline architecture replicating the existing process.
Analyze, explore and select the appropriate tools for data migration and transformation.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Keep data separated and secured using masking and encryption.
Work with data and analytics experts to strive for greater functionality in data systems.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.