02 Sep
|
Wells Fargo
|
Hyderabad
02 Sep
Wells Fargo
Hyderabad
About this role:
- Wells Fargo is seeking a Senior Data Engineer.
- We are seeking a Senior Data Engineer to build and modernize scalable data platforms on GCP while enabling AI/GenAI-driven data solutions.
- The ideal candidate will have strong expertise in cloud data engineering, large-scale data processing, and modern AI-enabled data architectures
In this role, you will:
- Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
- Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
- Review and analyse moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
- Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
- Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
- Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals
Required Qualifications:
- 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Job Expectations
- Design, build, and optimize scalable data pipelines using Python, SQL, Spark,
and GCP services.
- Develop batch and streaming solutions using BigQuery, Dataproc, Cloud Composer, Kafka, and Pub/Sub.
- Lead cloud migration, data transformation, reconciliation, and data quality initiatives. Implement metadata, lineage, governance, and observability using Dataplex and Data Catalog.
- Build data products that support AI use cases including semantic search, RAG, embeddings, and knowledge graphs.
- Develop APIs and data services to support AI agents and intelligent workflows. Collaborate with product, platform, security, and business teams to deliver reliable, scalable solutions.
- Drive engineering excellence through automation, CI/CD, monitoring, and reusable frameworks.
Additional Required Skills
- Solid experience in Python, SQL, Spark, and Data Engineering.
- Hands-on experience with GCP (BigQuery, Dataproc, Composer, Pub/Sub).
- Experience building enterprise-scale ETL/ELT and streaming solutions.
- Understanding of data modeling, governance, and cloud architecture. Familiarity with LLMs, prompt engineering, vector search, or AI-powered applications.
- Experience with REST APIs, Git, and CI/CD practices.
Desired Skills:
- Neo4j or Graph Databases.
- Vector Databases, RAG, and Semantic Search.
- LangChain, LlamaIndex, Semantic Kernel, or similar frameworks.
- Docker, Kubernetes, and MLOps concepts.
- AI Governance and Responsible AI practices.
- Key Technologies: GCP, BigQuery, Dataproc, Spark, Python, SQL, Kafka, Pub/Sub, Dataplex, Airflow, LLMs, Neo4j, Vector Databases, RAG, LangChai
📌 Senior Data Engineer (Python/ Spark/GCP) (Hyderabad)
🏢 Wells Fargo
📍 Hyderabad