We are an AI-led platform-driven Digital Engineering and Enterprise Modernization partner combining deep technical expertise and industry experience to help our clients anticipate whats next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India and numerous innovators across the healthcare ecosystem.
Our disruptors mindset commitment to client success and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation leadership and inclusion. We reported $1654.4M FY26 revenue with 17.4% Y-o-Y growth. We have delivered 24sequential quarters of growth with $436.0M in Q2 FY27 revenue up 3.2% Q-o-Q and 16.2% Y-o-Y growth. Our 27500global team members located in 18 countries have been instrumental in helping the market leaders transform their industries. We have been recognized as theFastest Growing IT Services Brand Globally in the 2026 Brand Finance IT Services 25 Report. We named a Leader in theEverest Group Private Equity (PE) Services PEAK MatrixAssessment 2026andSoftware Product Engineering PEAK MatrixAssessment 2026.
About Position:
We are looking for a highly skilled Backend AI Engineer to design build and operate enterprise-grade AI and Agentic AI applications using TypeScript Python and . The ideal candidate will be responsible for developing scalable backend services that integrate Large Language Models (LLMs) AI Agent frameworks enterprise systems laboratory platforms knowledge bases vector databases and cloud-native infrastructure.
- Role: Backend AI Engineer
- Location: All Persistent Locations
- Experience: 4 to 8 Years
- Job Type: Full time Employment
What Youll Do:
- Design and develop backend AI services APIs orchestration layers and integration components using TypeScript Python and .
- Build scalable backend services supporting AI Agents Copilots Assistants and workflow automation platforms.
- Develop REST APIs asynchronous services event-driven workflows background jobs queues WebSocket and SSE streaming services.
- Design robust service architectures that support enterprise-scale AI workloads.
- Build and implement Agentic AI workflows using LangChain LangGraph MCP SDK Semantic Kernel CrewAI AutoGen OpenAI-compatible APIs.
- Develop intelligent agent capabilities including Tool Calling Function Calling Task Planning Workflow Orchestration Memory Management Structured Outputs Execution Monitoring Error Recovery Mechanisms.
- Design graph-based workflow automation and multi-agent systems.
- Integrate cloud and on-premise LLMs including OpenAI Models Qwen DeepSeek GLM Other Enterprise-Approved Models.
- Implement prompt engineering strategies and model optimization techniques.
- Develop secure and scalable AI-powered applications and services.
- Evaluate and improve LLM response quality and system performance.
- Design and implement Model Context Protocol (MCP) integrations.
- Develop MCP client and server implementations.
- Manage using Tool Registration Access Controls Permissions Management Service Onboarding Logging & Monitoring Secure Connectivity.
- Integrate AI systems with enterprise applications and business workflows.
- Build enterprise-grade RAG pipelines.
- Develop Document Parsing Chunking Strategies Embedding Pipelines Vector Search Frameworks Knowledge Ingestion Pipelines Retrieval Evaluation Mechanisms.
- Improve knowledge quality retrieval accuracy and contextual reasoning capabilities.
- Integrate AI systems with structured and unstructured enterprise knowledge sources.
- Design semantic data structures supporting AI reasoning and intelligent workflows.
- Build and maintain Knowledge Graphs Metadata Models Ontologies Taxonomies Entity Relationships Graph Databases.
- Implement hybrid Graph Vector Search architectures.
- Enable advanced semantic search and contextual AI capabilities.
- Design and deploy cloud-native AI applications using AWS services.
- Build containerized workloads using Docker and Kubernetes.
- Implement CI/CD pipelines and deployment automation.
- Develop scalable and resilient infrastructure supporting AI workloads.
- Automate system provisioning monitoring and operational processes.
- Implement monitoring logging and observability capabilities.
- Build OpenTelemetry Instrumentation Distributed Tracing Performance Monitoring Cost Tracking AI Evaluation Frameworks.
- Monitor model performance latency reliability and operational health.
- Troubleshoot production issues and optimize system performance.
- Collaborate with AI Product Owners Data Scientists Software Engineers Application Scientists QA Teams Support Teams Business Stakeholders.
- Participate in solution design workshops and architecture discussions.
- Contribute to technical standards and engineering best practices.
- Mentor junior engineers and support knowledge-sharing initiatives.
Expertise Youll Bring:
- Experience working with laboratory scientific or automation environments.
- Knowledge of Knowledge Graph technologies.
- Experience with OpenTelemetry and observability platforms.
- Exposure to MLOps and AI model lifecycle management.
- Familiarity with multi-tenant architectures and SaaS platforms.
- Experience implementing AI governance and security controls.
- Knowledge of distributed systems and high-availability architectures.
- Strong experience with TypeScript Python.
- Expertise in asynchronous programming and backend service development.
- Strong understanding of REST APIs WebSockets Server-Sent Events (SSE) Event-Driven Architectures Microservices.
- Hands-on experience with LangChain LangGraph MCP SDK LlamaIndex Semantic Kernel CrewAI AutoGen.
- Experience building AI Agents AI Assistants Copilots Workflow Automation Solutions.
- Strong understanding of Large Language Models (LLMs) Prompt Engineering Tool Calling Structured Outputs Memory Management Agent Orchestration AI Evaluation.
- Experience integrating OpenAI-compatible models and enterprise AI platforms.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties flexible work hours and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life personal accident and Mediclaim hospitalization for self spouse two children and parents
Values-Driven People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals including those with disabilities and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements please inform us during the application process or at any time during your employment
Lets unleash your full potential at Persistent- is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.
Required Experience:
IC
📌 Backend AI Engineer (Pune)
🏢 Persistent Systems
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.