10 Sep
|
Tredence
|
Bengaluru
10 Sep
Tredence
Bengaluru
Role: GCP Scala Architect
Location – Bangalore, Chennai, Pune, Kolkata and Gurugram
We are seeking a Senior Data Engineering Architect with extensive expertise in large-scale data processing, enterprise pipeline design, and business intelligence architecture within the retail domain.
In this role, you will lead the end-to-end design and execution of our enterprise data platform, processing high-volume retail transactions, customer interactions, and inventory feeds. You will bridge the gap between heavy-duty Data Engineering (using Scala, Apache Spark, and GCP Dataproc) and Business Intelligence delivery (via Power BI, Looker semantic models, and executive dashboards). The ideal candidate brings a proven track record of architecting performant pipelines for massive datasets while ensuring seamless, high-speed reporting for analytical end-users.
Key Responsibilities
1. Data Engineering & Pipeline Architecture
System Design: Architect, scale, and maintain robust, fault-tolerant batch and streaming data pipelines on Google Cloud Platform (GCP) using GCP Dataproc, GCS,
and Big Query. Code Execution & Development: Core pipeline development using Scala and Apache Spark, enforcing high coding standards, modular design patterns, and automated testing strategies. Pipeline Optimization: Conduct deep performance tuning on Spark jobs, memory management, shuffle partitioning, and execution plans to ensure ultra-low execution latency and cost-effective cloud resource usage. 2. Semantic Modeling & BI Layer Architecture
Semantic Layer Design: Build, standardize, and govern unified semantic models in Looker (Look ML) and Power BI (Tabular Models / DAX) for enterprise-wide analytics. Dashboard & Report Engineering: Partner with analytical teams to translate retail business requirements into performant, intuitive reporting interfaces and dashboards. Query Performance Tuning: Optimize BI connection modes (Direct Query, Import, Dual Mode, Aggregation Tables) and underlying data store sch
📌 Senior architect (Bengaluru)
🏢 Tredence
📍 Bengaluru