Job Description Day to Day
This person will own the design, testing, and optimization of prompts for several internal GenAI applications, working closely with AI engineers, data teams, and SMEs to improve accuracy and reduce hallucinations. They'll troubleshoot whether poor responses are caused by the prompt, RAG/retrieval process, vectorization, content, or underlying data and then partner with the appropriate team to fix the issue. The ultimate goal is to make the AI applications faster and more reliable for both technical and non-technical users.
Key Responsibilities
Design, develop, test, manage, and maintain production prompts for multiple Generative AI applications.
Optimize prompts for both sophisticated technical users and users with limited AI experience.
Improve AI response accuracy, consistency, relevance, and speed while reducing hallucinations.
Diagnose whether poor AI responses originate from:
Prompt design
User inputs
Retrieved content
RAG/retrieval performance
Vectorization or data
Application behavior
Collaborate directly with AI engineers, data engineers, data scientists, SMEs, and content builders.
Apply a strong understanding of RAG architecture, retrieval, embeddings/vectorization, tokenization, and context/token limits.
Help determine how AI applications should guide users toward effective inputs and reliable responses.
Work with data originating from Snowflake/data lake environments and AWS-based AI services.
Use Python and modern AI development tools to test, evaluate, and improve GenAI application behavior.
Support multiple AI applications designed around high-volume technical service use cases.
Collaborate with globally distributed teams across India, Europe, and the United States. Skills and Requirements Required Qualifications
Strong hands-on experience with Generative AI and LLM-based applications.
Demonstrated expertise designing, testing, and optimizing prompts for production AI applications.




Strong knowledge of Retrieval-Augmented Generation (RAG) architectures and workflows.
Understanding of embeddings, vectorization, vector databases, tokenization, context windows, and retrieval strategies.
Experience troubleshooting hallucination, retrieval, data quality, and prompt-related issues.
Strong Python skills.
Experience with AWS technologies and services.
Experience working with Snowflake, data lakes, or comparable enterprise data platforms.
Ability to communicate effectively with AI engineers, data teams, technical SMEs, and business users.
Robust technical foundation in data, engineering, AI, or a closely related discipline.
Ability to work fully onsite in Pune during the required 2:30 PM-10:30 PM IST schedule.
Preferred Qualifications
Data Science, Data Engineering, ML Engineering, or engineering background.
Experience with Claude Code and/or Cursor.
Familiarity with MCP / Model Context Protocol.
Hands-on experience with vector databases and AWS-based retrieval/vectorization technologies.
Experience supporting GenAI applications in technical, infrastructure, data center, electrical, mechanical, or other engineering environments.
Experience building evaluation methodologies for prompt and RAG quality. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

📌 INTL- India- AI Prompt Engineer (Pune)
🏢 Insight Global
📍 Pune