12 Sep
|
Quantiphi
|
Tumakuru
12 Sep
Quantiphi
Tumakuru
As a Senior Data Engineer, you are a technical leader within the Data Engineering organisation. You don't just build — you architect, mentor, and set the standard. You lead high-priority initiatives end to end, from requirements through to production, and your decisions meaningfully shape the team's technical direction.
You operate at the frontier of up-to-date data engineering. You understand that AI is not a future consideration — it is a present-day design constraint. You build data infrastructure that is AI ready by default: pipelines that serve feature stores, architectures that can support RAG and LLM applications, and platforms capable of integrating AI-assisted tooling at every stage of the engineering lifecycle.
In a global team spanning Europe, the US, and India, you are a connector — bridging technical depth with business context, and aligning local delivery with global standards.
What You Will Do
Technical Architecture & Delivery
- Lead the end-to-end design and delivery of complex data engineering solutions on GCP — from architecture through production deployment
- Architect scalable, cost-effective data platforms using BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataplex, and Cloud Storage
- Design robust data models using Dimensional (Kimball), 3NF, and Data Vault methodologies — selecting the right approach for each use case
- Implement SCD strategies and historical data management patterns for long-lived datasets
- Lead the migration of legacy data structures to GCP, defining parallel testing and data parity validation strategies
- Provision and govern cloud infrastructure using Terraform;
champion IaC as a non-negotiable standard
- Design and implement CI/CD pipelines for all data solutions — with automated testing, linting, and deployment gates
AI-Era Responsibilities
- AI-ready architecture: Design every data platform component to be downstream-AI compatible — appropriate partitioning, feature store integration, and schema design for ML consump
📌 Senior Data Engineer (Tumakuru)
🏢 Quantiphi
📍 Tumakuru