27 Oct
|
Data Eminence
|
India
27 Oct
Data Eminence
India
As a Prompt Engineer (AI Training), you will help improve the reasoning, instruction-following, and conversational capabilities of next-generation AI systems. You will leverage your expertise in prompt design, AI interaction, and language reasoning to evaluate, create, review, and refine high-quality prompts and AI responses that enable Large Language Models (LLMs) to perform complex tasks accurately and reliably. Your responsibilities may include designing prompts, evaluating AI-generated responses, comparing multiple model outputs, creating benchmark tasks, identifying reasoning and factual errors, improving prompt quality, and ensuring AI-generated content is accurate, safe, and aligned with user intent. You'll collaborate with AI researchers and data teams to help train and fine-tune cutting-edge Generative AI models. Responsibilities
• Design, evaluate, and optimize prompts for Large Language Models (LLMs).
• Review AI-generated responses for correctness, relevance, reasoning quality, and instruction adherence.
• Create, rewrite, and improve prompts across domains including coding, business, writing, reasoning, mathematics, and general knowledge.
• Compare multiple AI-generated responses and rank them based on quality, accuracy, completeness, and usefulness.
• Identify hallucinations, factual inaccuracies, reasoning errors, and inconsistencies in AI outputs.
• Develop benchmark datasets and evaluation tasks for AI model assessment.
• Annotate conversational data, prompts, and AI-generated responses following detailed guidelines.
• Improve prompt effectiveness by experimenting with different prompting strategies and techniques.
• Perform quality assurance on prompt datasets, annotations, and AI-generated outputs.
• Collaborate with AI researchers to improve model performance across diverse real-world use cases.
• Follow detailed annotation and evaluation guidelines while maintaining high-quality standards. Requirements
• Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, Linguistics, Business, Mathematics, or a related field.
• Excellent written communication and analytical reasoning skills.
• Robust understanding of Generative AI and Large Language Models (LLMs).
• Ability to write explicit, structured, and unambiguous prompts.
• Strong problem-solving skills and attention to detail.
• Ability to evaluate AI responses objectively and provide constructive feedback.
• Basic computer and internet proficiency.
• Prior experience in Prompt Engineering, AI training, content evaluation, technical writing, software development, research, or data annotation is preferred but not mandatory. Preferred Qualifications
• Experience working with Large Language Models (LLMs) such as ChatGPT, Gemini, Claude, Llama, Mistral, or similar AI systems.
• Familiarity with prompt engineering techniques including Zero-shot, Few-shot, Chain-of-Thought, Role Prompting, Structured Prompting, and Prompt Chaining.
• Understanding of AI evaluation methodologies, reinforcement learning from human feedback (RLHF), or preference ranking.
• Experience with programming languages such as Python or JavaScript is a plus.
• Knowledge of AI safety, responsible AI, and model evaluation practices.
• Experience using AI-powered productivity and coding tools.
• Strong attention to detail and commitment to delivering high-quality work. Skills
• Prompt Engineering
• Large Language Models (LLMs)
• Generative AI
• AI Response Evaluation
• Prompt Optimization
• AI Data Annotation
• Content Review
• Preference Ranking
• Logical Reasoning
• Critical Thinking
• Technical Writing
• Quality Assurance
• Problem Solving
• Communication Skills What You'll Gain
• Work on cutting-edge Generative AI and Large Language Model (LLM) projects.
• Flexible remote work opportunities.
• Gain hands-on experience in AI model training, prompt engineering, and model evaluation.
• Develop expertise in LLM optimization, AI reasoning, prompt design, and Generative AI technologies.
• Collaborate with global AI researchers, engineers, and data teams to build next-generation AI systems.
📌 Prompt Engineer (India)
🏢 Data Eminence
📍 India