12 Sep
|
Quantiphi
|
Bengaluru
12 Sep
Quantiphi
Bengaluru
Job Description
As a Senior Data Engineer, you are a technical leader within the Data Engineering organisation. You don't just build — you architect, mentor, and set the standard. You lead high-priority initiatives end to end, from requirements through to production, and your decisions meaningfully shape the team's technical direction. You operate at the frontier of up-to-date data engineering. You understand that AI is not a future consideration — it is a present-day design constraint. You build data infrastructure that is AI ready by default: pipelines that serve feature stores, architectures that can support RAG and LLM applications, and platforms capable of integrating AI-assisted tooling at every stage of the engineering lifecycle. In a global team spanning Europe, the US, and India, you are a connector — bridging technical depth with business context, and aligning local delivery with global standards.
What You Will Do Technical Architecture & Delivery - Lead the end-to-end design and delivery of complex data engineering solutions on GCP — from architecture through production deployment - Architect scalable, cost-effective data platforms using BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataplex, and Cloud Storage - Design robust data models using Dimensional (Kimball), 3NF, and Data Vault methodologies — selecting the right approach for each use case - Implement SCD strategies and historical data management patterns for long-lived datasets - Lead the migration of legacy data structures to GCP, defining parallel testing and data parity validation strategies - Provision and govern cloud infrastructure using Terraform; champion IaC as a non-negotiable standard - Design and implement CI/CD pipelines for all data solutions — with automated testing, linting, and deployment gates AI-Era Responsibilities - AI-ready architecture: Design every data platform component to be downstream-AI compatible — appropriate partitioning, feature store integration, and schema design for
📌 Senior Data Engineer (Bengaluru)
🏢 Quantiphi
📍 Bengaluru