Job Title: Lead AI Engineer – Core Platform
Experience:4 – 8 Years
Employment Type: Full-time, Permanent
Immediate to 30 days preferred
We are a technology company specialising in AI evaluation and trust infrastructure, headquartered in Ahmedabad, Gujarat. Our platform enables organisations to assess the reliability, safety and performance of AI-powered applications.
We are seeking an experienced Lead AI Engineer to define the technical architecture of our platform and lead the design and development of its core evaluation engine. Define the end-to-end system architecture, technical roadmap and engineering standards for the platform, covering mobile, web, administration and core services.
Prepare and maintain detailed technical documentation, including architecture blueprints, data models and implementation plans for the wider engineering team.
Design, develop and maintain a real-time evaluation engine for verifying the behaviour of AI systems against defined criteria.
Implement LLM-based evaluation frameworks, including rubric-based scoring, confidence thresholds and human-in-the-loop review workflows.
Develop a configuration-driven framework that enables new evaluation scenarios to be deployed without code changes.
Design and implement integrity controls, including fraud detection, anomaly detection and safeguards against manipulation.
Establish best practices for testing,



observability, security, performance and cloud cost optimisation.
4–8 years of professional software engineering experience, including a minimum of 2 years building and operating LLM-based applications in production environments.

- Hands-on experience with LLM evaluation methodologies (LLM-as-a-judge, rubric-based scoring, evaluation datasets) or automated assessment systems (online judges, assessment platforms).
- Experience implementing agentic workflows and tool/function calling with commercial and open-weight models (e.g. Robust proficiency in Python and/or TypeScript.
- Strong working knowledge of PostgreSQL, event-driven architectures, message queues and observability tooling.
- Proven experience delivering products from concept to production.

Experience in AI red-teaming, prompt-injection mitigation or application security testing.

- Experience with fraud detection, risk management or trust and safety systems.
- Familiarity with Supabase, React Native/Expo and cloud platforms (AWS, GCP or Azure).

Working knowledge of Gujarati and/or Hindi will be an added advantage.
B.E. / B.Tech / M.Tech / MCA in Computer Science, Information Technology or a related discipline.

COMPENSATION

Competitive and commensurate with experience, with a performance-linked bonus.

📌 Lead AI Platform Engineer (India)
🏢 Kotech Solutions
📍 India