The Senior Software Engineer will join the AI Center of Excellence team at Epsilon, focusing on enterprise-grade Conversational, Agentic, and AI platforms. This role requires a robust software engineering background and deep expertise in Generative AI, RAG, and Agentic systems to build and scale AI-powered applications for global clients.

Responsibilities include the full lifecycle of AI development, from ideation and prototyping to production hardening and operational governance. Core Engineering &

- Architecture: Design and ship production-grade AI applications, including conversational assistants and multi-agent systems. Architect scalable backend services using Python and Node.js on cloud platforms (AWS/Azure/GCP). Build RESTful and streaming APIs. Generative AI &
- LLM Systems: Optimize LLM-powered features, including prompt engineering, tool calling, and context management. Implement evaluation frameworks for groundedness and quality benchmarking. Work with LLM APIs like Azure OpenAI, AWS Bedrock, and Anthropic. RAG &
- Agentic AI:



Build enterprise RAG pipelines with vector databases and hybrid retrieval. Design autonomous agentic workflows for multi-step business processes. Data &
- Analytics: Perform data wrangling, EDA, and statistical analysis to validate model behavior. Collaborate with data engineering teams. Governance &
- Ops: Implement Responsible AI practices, including guardrails for hallucination and PII protection. Manage MLOps/LLMOps pipelines for deployment and monitoring.

Qualifications: Must have 5- 8+ years of software engineering experience, with at least 2+ years hands-on in Generative AI/LLM systems. Proficiency in Python, backend frameworks, and cloud-native patterns is required .

Experience with Databricks, SQL, and system design for distributed AI is essential . A Bachelor's or Master's degree in Computer Science, AI, or Data Science is preferred .

PythonGenerative AILLMRAGAgentic AIFastAPIFlaskNode.jsAWSAzureGCPDatabricksSQLPrompt EngineeringVector DatabasesCI/CDMLOpsLLMOps

📌 Senior Software Engineer (Bengaluru)
🏢 AI Job Fever
📍 Bengaluru