Role Overview: We are looking for a Senior Engineer AI Platform to design, develop, and improve enterprisescale AI infrastructure and platform capabilities.

The role combines platform engineering, distributed systems, cloud infrastructure, and Generative AI/Agentic

AI, with a focus on building highly scalable, secure, resilient, and high-performance AI platforms.

Key Responsibilities

- Design and develop enterprise-scale AI platform and infrastructure solutions.
- Build highly available distributed systems using active-active and failover architectures.
- Develop high-throughput, low-latency production services and APIs.
- Design and manage cloud-native AI infrastructure across AWS and Kubernetes.
- Build infrastructure supporting LLM and Agentic AI workloads.
- Implement and optimise AI model serving and inference infrastructure.
- Integrate AI platforms with enterprise applications and services.
- Collaborate with architects, product managers, engineers, and business stakeholders.
- Participate in code reviews and promote engineering best practices.
- Implement secure coding, testing, monitoring, and reliability practices.
- Contribute to technology strategy, platform standards, and continuous improvement.

Technical Requirements
- 7+ years of software/platform engineering experience, including 5+ years working with enterprisescale platform or infrastructure architecture.
- Strong experience with distributed systems, high availability, active-active architecture, and failover

patterns.
- Expert-level proficiency in Python, particularly FastAPI and asynchronous programming; Go or Java

experience is also valuable.
- Strong AWS experience, including:
- EKS




- Bedrock
- IAM
- Aurora
- CloudFormation
- GPU scheduling
- Multi-tenancy
- Strong knowledge of Kubernetes and containerised infrastructure.
- Experience with service mesh technologies, particularly Istio and Envoy.
- Hands-on experience with Generative AI and Agentic AI, including:
- LangGraph / LangChain
- Google ADK
- MCP
- A2A protocols
- Prompt engineering
- RAG
- vLLM
- Experience building high-performance AI/ML platform infrastructure.

Preferred / Additional Skills
- Experience implementing AI safety and guardrails, including:
- Prompt injection detection
- PII redaction
- Content filtering
- Knowledge of AI security frameworks such as:
- NIST AI RMF
- MITRE ATLAS
- OWASP LLM Top 10
- Strong experience with Envoy Proxy, including xDS API, WASM filters, and AI Gateway extensions.
- Experience with GPU infrastructure and AI inference optimisation.
- Financial services or banking experience, particularly around regulatory requirements, data residency,

and compliance. Leadership & Stakeholder Skills
- Strong analytical and problem-solving capabilities.
- Ability to influence technical direction and architectural decisions.
- Strong communication and stakeholder management skills.
- Ability to collaborate across engineering, product, architecture, and business teams.
- Experience mentoring and guiding less experienced engineers.
- Ability to manage technical risks and strengthen platform controls.
- Solid understanding of enterprise technology strategy and cloud architecture.

Education
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical

discipline

📌 Senior Engineer _AI Platform (Bengaluru)
🏢 Net Connect
📍 Bengaluru