Position: AI Engineer

Experience: 7+ years

Employment Type: Full Time / Hybrid

:

- Strong hands-on experience in AI Engineering, with a focus on designing, developing, and deploying production-ready Agentic AI solutions.
- Proven experience building agentic AI applications and orchestration frameworks using technologies such as LangChain or equivalent agentic AI frameworks.
- Design and develop agent evaluation frameworks/harnesses to systematically assess agent accuracy, reliability, reasoning, tool usage, and overall performance.
- Hands-on experience with evaluation tools such as DeepEval, RAGAS, LangSmith Evals, Langfuse, or similar AI evaluation platforms.
- Experience creating and maintaining golden datasets and evaluation benchmarks, including gathering requirements through user interviews, product walkthroughs, and real-world usage scenarios.
- Build and implement AI guardrails within agentic frameworks such as LangChain or through platforms such as Amazon Bedrock Guardrails.
- Strong understanding of responsible AI, safety, security, hallucination prevention, prompt protection,



and policy enforcement for enterprise AI applications.
- Hands-on experience developing AI skills, tools, function calling capabilities, and MCP (Model Context Protocol) servers to enable agents to interact with enterprise systems and services.
- Ability to work closely with product, engineering, and business teams to translate real-world requirements into scalable and reliable AI agent solutions.
- Take complete production ownership—from design and development through testing, deployment, monitoring, troubleshooting, and continuous improvement—with a strong “build it, ship it, own it” mindset.

If you are interested, kindly share your updated resume to [email protected] Pay: ₹2,500,000.00 - ₹3,200,000.00 per year

Advantages

- Flexible schedule
- Health insurance
- Leave encashment
- Paid sick time
- Paid time off
- Provident Fund

Work Location: Hybrid remote in Bengaluru, Karnataka (Bengaluru, Bengaluru Urban District)

📌 AI Engineer / Full Time / Hybrid (Bengaluru)
🏢 First Soft Digital Solutions
📍 Bengaluru