About LetitbexAI:
LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.

Position: AI Agent Evaluation Engineer

Experience: 8+ Years

Notice Period: Can be considered up 15 Days

Job Position (Title): AI Agent Evaluation Engineer

Experience: 8+ Years
- Job Summary:
- Required Skills & Qualifications:
- Experience: 8+ years in Software QA, with at least 2-3 years focused on testing or evaluating AI/ML systems, conversational agents, or Large Language Models (LLMs).
- Safety Evals Expertise (mandatory): Direct experience in designing and executing safety evaluations (red teaming, adversarial testing), bias detection,



and measuring toxicity/harmful content in generative AI models.
- Google ADK Familiarity (mandatory): Direct or robust conceptual understanding of the Google Agent Development Kit (ADK) and its components.
- Programming: Strong proficiency in Python is mandatory for script development, data processing, and automation.
- Cloud & MLOps: Familiarity with Google Cloud Platform (GCP) services relevant to AI/ML (e.g., Vertex AI) and integrating testing into MLOps workflows.
- Communication: Excellent analytical, problem-solving, and communication skills to articulate complex agent behaviors, risks, and safety findings clearly.
- Tools and Libraries: Langsmith, DeepEval, Ragas, Giskard, Hugging face.

📌 Ai Agent Evaluation Engineer (Hyderabad)
🏢 Letitbex Ai Tech Solutions
📍 Hyderabad