AI Manager

About the Role

We are looking for a AI Manager to own the end-to-end technical architecture of a production-grade, multi-agent AI platform deployed in US regulated financial institutions. This is not an advisory or strategy role it is a hands-on architecture role with accountability for system design decisions that affect security, regulatory compliance, scalability, and operational reliability.

The platform operates in some of the most demanding technical environments in enterprise software: BYOC deployments inside bank Azure and GCP tenants, confidential computing enclaves, offline cryptographic licensing, and HITL-governed agentic pipelines that must produce immutable audit trails defensible to federal regulators. Every architectural decision has regulatory implications.

Scope of Responsibility

PLATFORM ARCHITECTURE

- Own the overall technical architecture of a multi-agent AI platform — defining component boundaries, data flows, integration patterns, and deployment topologies across cloud environments (Azure and GCP)
- Architect the Model Abstraction Layer — decoupling agent orchestration logic from specific model providers and versions, enabling zero-downtime model upgrades and multi-cloud model serving flexibility
- Define and maintain the Blue-Green deployment architecture — parallel environment management, traffic shifting strategy, rollback procedures, and regression testing gates for model version changes
- Design scalable Kubernetes-based deployment topology (AKS / GKE) — node pool architecture, namespace isolation, pod security policies, Workload Identity Federation, resource quota management

SECURITY ARCHITECTURE

- Architect the BYOC (Bring Your Own Cloud) deployment model — ensuring all platform components operate within the client institution's cloud tenant with zero data egress to Anaptyss infrastructure
- Design the offline cryptographic licensing system — RSA-4096 JWT-based license enforcement that operates without network dependency, supporting both air-gapped and hybrid deployment modes
- Define encryption architecture: CMEK via Azure Key Vault / GCP Cloud KMS for at-rest encryption; TLS 1.3 for in-transit; confidential computing enclaves for in-processing
- Architect network security posture: VPC Service Controls (GCP) / Azure Private Endpoints,



Private Service Connect / Private Link for model serving, no public IP surfaces on core components
- Define identity and access architecture: AAD/Entra ID or Google Cloud Identity SSO integration, Workload Identity Federation for service-to-service authentication, RBAC with principle of least privilege
- Design audit logging architecture — immutable audit trail system capturing every agent action, HITL decision, evidence retrieval, and output version in structured, tamper-evident form

AI SYSTEM ARCHITECTURE

- Architect the agentic pipeline framework — multi-stage workflow orchestration, inter-agent communication protocols, state persistence across HITL gates, and graceful degradation on component failure
- Define the RAG (Retrieval Augmented Generation) architecture — embedding model selection, vector store integration, chunking and indexing strategy, retrieval precision and recall optimisation, context window management for large document corpora
- Design deterministic tool architecture — separation of AI reasoning layer from data retrieval layer, tool interface contracts, error handling, evidence validation logic, and auditability of every data access operation
- Architect stateless agent execution — ensuring no cross-session memory accumulation, no passive learning from runtime data, and full reproducibility of pipeline outputs given equivalent inputs

CLOUD & INFRASTRUCTURE ARCHITECTURE

- Design multi-cloud deployment architecture supporting both Azure and GCP — abstracting cloud-specific components behind common interfaces while leveraging cloud-native managed services appropriately on each platform
- Architect data persistence layer: relational database (Azure SQL / Cloud SQL PostgreSQL) for structured outputs and audit trail; object storage (Azure Blob / GCS) for document and artefact storage — with appropriate partitioning, indexing, retention, and CMEK encryption




- Design observability architecture: telemetry strategy (Azure Monitor + App Insights / GCP Cloud Monitoring + Cloud Logging) that provides operational visibility while keeping all telemetry within the client's cloud tenant
- Define container image supply chain security: image signing (Sigstore/Binary Authorization), registry architecture (Azure Container Registry / Google Artifact Registry), Kubernetes admission control for signature verification

INTEGRATION ARCHITECTURE

- Design the enterprise system integration layer — defining connectivity patterns for read-only evidence retrieval from ERP, identity/access management, GRC, and workflow systems across on-premises and cloud-hosted environments
- Architect GRC platform integration — defining output delivery formats (JSON, PDF, CSV), API-based and file-based delivery patterns, and data mapping between ANA's output schema and client GRC platform import specifications
- Define the client deployment package architecture — Helm charts, Terraform modules, container image delivery via shared registry, cryptographic signature verification, and zero-Anaptyss-access deployment process

Required Experience & Skills

ARCHITECTURE & SYSTEMS DESIGN — ESSENTIAL

- 8+ years in enterprise software architecture, with at least 3 years in AI/ML platform architecture
- Demonstrable experience designing production systems that were deployed in regulated environments — financial services, healthcare, government, or equivalent — where architectural decisions had compliance and regulatory implications
- Deep expertise in cloud-native architecture on Azure and/or GCP — proven ability to design production systems using managed services, Kubernetes, IAM, encryption, and networking on at least one platform; working familiarity with the other
- Experience designing BYOC (Bring Your Own Cloud) or tenant-isolated deployment models — where customer data must remain within the customer's cloud workplace
- Hands-on experience with confidential computing — Azure Confidential Computing (DCv3/Intel SGX), GCP Confidential VMs (AMD SEV/Intel TDX), or equivalent — at the architecture level (not necessarily implementation detail)

If interested kindly share your resume at [email protected]

📌 AI Manager (Noida)
🏢 NLB Services
📍 Noida