10 Aug
|
State Street
|
Hyderabad
10 Aug
State Street
Hyderabad
AI Data & Knowledge Engineer - AVP
About the Role
Key Responsibilities
- Lead architecture and technical design for AI-ready data platforms, including ingestion, transformation, storage, serving, and retrieval layers.
- Define standards for scalable batch and streaming data pipelines, ETL/ELT frameworks, and backend data services supporting AI applications.
- Own data and knowledge architecture across the platform, including knowledge graphs, ontologies, semantic models, and retrieval architectures.
- Establish and enforce standards for data contracts, lineage, observability, governance, and quality controls for AI systems.
- Partner with platform, architecture, and AI engineering teams to design robust integration patterns across enterprise source systems and AI services.
- Drive adoption of contemporary data engineering practices, including orchestration, CI/CD for data pipelines, reusable framework components, and automated quality checks.
- Lead evaluation and implementation of technologies across big data processing, vector search, graph stores, metadata tooling,
and AI data infrastructure.
- Coach and develop Officers and Senior Associates; support hiring and capability building across the pod.
- Represent the Data/Knowledge function in architecture reviews, governance forums, and cross-functional planning discussions.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 8–14 years of experience in data engineering, data architecture, platform engineering, or large-scale data systems.
- Deep expertise in building scalable data pipelines, ETL/ELT frameworks, and backend data platforms.
- Strong experience with distributed data processing technologies such as Spark, Databricks, Flink, or equivalent ecosystems.
- Experience designing enterprise data architectures across data lakes, warehouses, lakehouses, and AI-serving layers.
- Strong understanding of orchestration, observability,
📌 AI Data (Hyderabad)
🏢 State Street
📍 Hyderabad