10 Sep
|
Quantiphi
|
Bengaluru
10 Sep
Quantiphi
Bengaluru
As a Senior Data Engineer, you are a technical leader within the Data Engineering organisation. You don't just build — you architect, mentor, and set the standard. You lead high-priority initiatives end to end, from requirements through to production, and your decisions meaningfully shape the team's technical direction.
You operate at the frontier of contemporary data engineering. You understand that AI is not a future consideration — it is a present-day design constraint. You build data infrastructure that is AI ready by default: pipelines that serve feature stores, architectures that can support RAG and LLM applications, and platforms capable of integrating AI-assisted tooling at every stage of the engineering lifecycle.
In a global team spanning Europe, the US, and India, you are a connector — bridging technical depth with business context, and aligning local delivery with global standards.
What You Will Do
Technical Architecture & Delivery
Lead the end-to-end design and delivery of complex data engineering solutions on GCP — from architecture through production deployment
Architect scalable, cost-effective data platforms using BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataplex, and Cloud Storage
Design robust data models using Dimensional (Kimball), 3NF, and Data Vault methodologies — selecting the right approach for each use case
Implement SCD strategies and historical data management patterns for long-lived datasets
Lead the migration of legacy data structures to GCP, defining parallel testing and data parity validation strategies
Provision and govern cloud infrastructure using Terraform; champion IaC as a non-negotiable standard
Design and implement CI/CD pipelines for all data solutions — with automated testing, linting, and deployment gates
AI-Era Responsibilities
AI-ready architecture: Design every data platform component to be downstream-AI compatible — appropriate partitioning, feature store integration, and schema design for ML consumption
GenAI data
📌 Senior Data Engineer (Bengaluru)
🏢 Quantiphi
📍 Bengaluru