Description
The Enterprise Next-Gen Big Data Engineering team works horizontally with all use-case and business teams across the organization. Rather than owning a single application or business domain, the team identifies optimization opportunities, establishes engineering standards, designs reusable frameworks, and creates common platform capabilities that accelerate development and improve operational excellence within the American Express Big Data ecosystem on Google Cloud Platform (GCP).
We are seeking a highly experienced and hands-on GCP Data Platform Engineer to improve engineering effectiveness, performance, scalability, and reliability of data platforms within the American Express Big Data ecosystem on GCP.
The ideal candidate has a robust foundation in GCP data services, distributed data processing, BigQuery, Apache Spark, Python, Airflow and software engineering, combined with practical experience building APIs and platform services using technologies such as Spring Boot and FastAPI on GCP.
Deep expertise in a specific business domain is not required.



We are looking for engineers who possess strong fundamentals in GCP-native data engineering, can quickly understand unfamiliar systems, identify bottlenecks and architectural weaknesses, and design pragmatic solutions that can be adopted across multiple teams. Strong conceptual understanding of GenAI, RAG, LLM applications, and agentic systems is required, with hands-on experience being a strong plus.

Responsibilities
- Partner with use-case and business teams to understand existing data platforms, workloads, and operational challenges; identify opportunities to improve performance, scalability, reliability, and cost-efficiency.
- Analyze and optimize large-scale Apache Spark and PySpark workloads, including joins, shuffles, partitioning, skew, caching, memory utilization, executor configuration, and resource allocation, and diagnose performance problems across distributed compute, storage, and orchestrati

📌 Data Engineer III (Bengaluru Urban)
🏢 American Express
📍 Bengaluru Urban