As a Prompt Engineer (AI Training), you will help improve the reasoning, instruction-following, and conversational capabilities of next-generation AI systems. You will leverage your expertise in prompt design, AI interaction, and language reasoning to evaluate, create, review, and refine high-quality prompts and AI responses that enable Large Language Models (LLMs) to perform complex tasks accurately and reliably.

Your responsibilities may include designing prompts, evaluating AI-generated responses, comparing multiple model outputs, creating benchmark tasks, identifying reasoning and factual errors, improving prompt quality, and ensuring AI-generated content is accurate, safe, and aligned with user intent. You'll collaborate with AI researchers and data teams to help train and fine-tune cutting-edge Generative AI models.

Responsibilities

- Design, evaluate, and optimize prompts for Large Language Models (LLMs).
- Review AI-generated responses for correctness, relevance, reasoning quality, and instruction adherence.
- Create, rewrite, and improve prompts across domains including coding, business, writing, reasoning, mathematics, and general knowledge.
- Compare multiple AI-generated responses and rank them based on quality, accuracy, completeness, and usefulness.
- Identify hallucinations, factual inaccuracies, reasoning errors, and inconsistencies in AI outputs.
- Develop benchmark datasets and evaluation tasks for AI model assessment.
- Annotate conversational data, prompts, and AI-generated responses following detailed guidelines.
- Improve prompt effectiveness by experimenting with different prompting strategies and techniques.
- Perform quality assurance on prompt datasets, annotations, and AI-generated outputs.
- Collaborate with AI researchers to improve model performance across diverse real-world use cases.
- Follow detailed annotation and evaluation guidelines while maintaining high-quality standards.

Requirements

- Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Engineering,



Linguistics, Business, Mathematics, or a related field.
- Excellent written communication and analytical reasoning skills.
- Strong understanding of Generative AI and Large Language Models (LLMs).
- Ability to write transparent, structured, and unambiguous prompts.
- Strong problem-solving skills and attention to detail.
- Ability to evaluate AI responses objectively and provide constructive feedback.
- Basic computer and internet proficiency.
- Prior experience in Prompt Engineering, AI training, content evaluation, technical writing, software development, research, or data annotation is preferred but not mandatory.

Preferred Qualifications

- Experience working with Large Language Models (LLMs) such as ChatGPT, Gemini, Claude, Llama, Mistral, or similar AI systems.
- Familiarity with prompt engineering techniques including Zero-shot, Few-shot, Chain-of-Thought, Role Prompting, Structured Prompting, and Prompt Chaining.
- Understanding of AI evaluation methodologies, reinforcement learning from human feedback (RLHF), or preference ranking.
- Experience with programming languages such as Python or JavaScript is a plus.
- Knowledge of AI safety, responsible AI, and model evaluation practices.
- Experience using AI-powered productivity and coding tools.
- Strong attention to detail and commitment to delivering high-quality work.

Skills

- Prompt Engineering
- Large Language Models (LLMs)
- Generative AI
- AI Response Evaluation
- Prompt Optimization
- AI Data Annotation
- Content Review
- Preference Ranking
- Logical Reasoning
- Critical Thinking
- Technical Writing
- Quality Assurance
- Problem Solving
- Communication Skills

What You'll Gain

- Work on cutting-edge Generative AI and Large Language Model (LLM) projects.
- Flexible remote work opportunities.
- Gain hands-on experience in AI model training, prompt engineering, and model evaluation.
- Develop expertise in LLM optimization, AI reasoning, prompt design, and Generative AI technologies.
- Collaborate with global AI researchers, engineers, and data teams to build next-generation AI systems.

📌 Prompt Engineer (India)
🏢 Data Eminence
📍 India