02 Oct
|
Deloitte
|
Bengaluru
02 Oct
Deloitte
Bengaluru
About the Company
Deloitte Global is the engine of the Deloitte network. Our professionals reach across disciplines and borders to develop and lead global initiatives. We deliver strategic programs and services that unite our organization.
About the Role
Work you'll do
• Focus: Designing scalable data ingestion frameworks and ensuring governed, well-tagged, high-quality data across the platform.
Responsibilities
• Designing scalable frameworks for various ingestion patterns to meet volume requirements.
• Working with core GCP data services such as BigQuery, Cloud Storage, Dataflow/Apache Beam, and Cloud Composer.
• Implementing streaming/messaging solutions using Kafka.
• Designing data-centric microservices patterns deployed in GKE.
• Creating templates for pipeline/config generation.
• Implementing data governance and cataloging using Atlan (metadata management, dataset tagging) and Google Dataplex (governance, lineage, quality tagging).
• Applying adjacent data layer knowledge (optional) including Oracle & SQL Server schema design (source system integration)
and data quality validation.
Qualifications
• Employer will accept a Bachelor's degree in Computer Science, Electronics Engineering, or related field and 7 years of experience in the job offered or in an IT Infrastructure Monitoring Engineer-related occupation.
Required Skills
• Key Skills:
• Ingestion Framework Design: Designing scalable frameworks for various ingestion patterns to meet volume requirements
• Core GCP Data Services: BigQuery, Cloud Storage, Dataflow/Apache Beam, Cloud Composer
• Streaming/Messaging: Kafka
• Microservices Architecture: Designing data-centric microservices patterns deployed in GKE
• Templating: Templates for pipeline/config generation
• Data Governance & Cataloging: Atlan (metadata management, dataset tagging), Google Dataplex (governance, lineage, quality tagging)
• Adjacent Data Layer Knowledge (optional): Oracle & SQL Server schema design (source system integration
📌 Data Architect (Bengaluru)
🏢 Deloitte
📍 Bengaluru