19 Aug
|
American Express
|
Bengaluru
19 Aug
American Express
Bengaluru
The Enterprise Next-Gen Big Data Engineering team works horizontally with all use-case and business teams across the organization. Rather than owning a single application or business domain, the team identifies optimization opportunities, establishes engineering standards, designs reusable frameworks, and creates common platform capabilities that accelerate development and improve operational excellence within the American Express Big Data ecosystem on Google Cloud Platform (GCP).
We are seeking a highly experienced and hands-on GCP Data Platform Engineer to improve engineering effectiveness, performance, scalability, and reliability of data platforms within the American Express Big Data ecosystem on GCP.
The ideal candidate has a strong foundation in GCP data services, distributed data processing, BigQuery, Apache Spark, Python, Airflow and software engineering, combined with practical experience building APIs and platform services using technologies such as Spring Boot and FastAPI on GCP.
Deep expertise in a specific business domain is not required.
We are looking for engineers who possess strong fundamentals in GCP-native data engineering, can quickly understand unfamiliar systems, identify bottlenecks and architectural weaknesses, and design pragmatic solutions that can be adopted across multiple teams. Strong conceptual understanding of GenAI, RAG, LLM applications, and agentic systems is required, with hands-on experience being a solid plus.
- Strong conceptual understanding of LLM-powered applications, Retrieval-Augmented Generation (RAG), agentic AI, and multi-agent architectures, including their data requirements and pipeline needs.
- Ability to design and build data engineering pipelines that feed GenAI processes, covering ingestion, chunking, embeddings, vector search, hybrid retrieval, and relevance optimization.
- Familiarity with Vertex AI, GenAI evaluation (groundedness, hallucination detection), and GenAI security considerations (prompt injection
📌 Data Engineer III (Bengaluru)
🏢 American Express
📍 Bengaluru