Job Title - Gen AI Senior Architect

Key Skills - AI & ML, LLM, LangGraph, LangChain, RAG, Python & Vector Database

Experience - 13+ years

Location - Hyderabad & Pune

We at Coforge are hiring a GenAI Senior Architecture with the following skillset:

- Develop and maintain the architectural framework for Generative AI and LLM-powered solutions, including RAG, AI agents, and multi-step workflows, ensuring alignment with business goals and technical standards.
- Lead the design, fine-tuning, and deployment of Generative AI models (e.g., GPT, DALL·E, Stable Diffusion) and LLM-based applications for use cases such as content generation, automation, copilots, and decision support systems.
- Design and implement LLM orchestration pipelines using frameworks such as LangChain, LangGraph, Semantic Kernel, or similar tools. Build agentic workflows, tool-augmented agents, and multi-step reasoning pipelines.
- Architect and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases (e.g., FAISS, Pinecone, Azure AI Search) and embedding models to enable enterprise knowledge integration.
- Collaborate with software engineering teams to integrate Generative AI capabilities, LLM services, and autonomous agents into existing applications, APIs, and enterprise workflows.
- Ensure AI/LLM solutions are scalable, optimized for latency and cost, and production-ready across cloud and hybrid environments.
- Implement and enforce ethical AI guidelines, including bias mitigation, explainability, safety guardrails, and responsible AI practices for LLM deployments.
- Stay abreast of advancements in LLMs, prompt engineering, agent frameworks, multimodal AI, and GenAI tooling,



incorporating emerging techniques into the AI strategy.
- Work closely with data scientists, ML engineers, product teams, and business stakeholders to identify AI-driven opportunities and ensure successful solution delivery.
- Create comprehensive documentation for AI architectures, LLM workflows, prompt templates, and best practices. Establish coding, evaluation, governance, and compliance standards.
- Minimum 7+ years of experience in AI/ML architecture or a related role.
- Proven experience in designing, developing, and deploying Generative AI and LLM-based solutions in production environments.
- Hands-on experience with LangChain, LangGraph, Semantic Kernel, or similar orchestration frameworks for building LLM pipelines and agent-based systems.
- Experience in developing RAG pipelines, integrating vector databases, and applying prompt engineering techniques.
- Strong experience with AI/ML frameworks and tools such as TensorFlow, PyTorch, and Hugging Face.
- Experience with cloud platforms such as AWS, Azure, or GCP, including the deployment of scalable AI/LLM solutions.

Technical Skills

- Proficiency in programming languages such as Python (preferred), Java, or C++.
- Strong expertise in LLMs, prompt engineering, embeddings, fine-tuning, and model optimization techniques.
- Hands-on experience with:
- LangChain, LangGraph, and agent frameworks
- Vector databases (Pinecone, FAISS, Weaviate, Azure AI Search)
- API integration and microservices architecture
- RAG architecture and knowledge retrieval systems
- Solid understanding of machine learning, deep learning, and MLOps concepts.
- Familiarity with AI governance, Responsible AI principles, model evaluation frameworks, and observability tools.

📌 Gen AI Senior Architect (Hyderabad)
🏢 Coforge
📍 Hyderabad