Job Summary

We are seeking a Applied AI Engineer with 3-4 years of experience to help design and build production-grade GenAI systems. In this role, you will contribute architecture coverage across the teamreviewing system designs, identifying gaps, and guiding technical decisions at the solution level. You will work on end-to-end LLM system design, Retrieval-Augmented Generation (RAG) pipelines, and multi-agent architectures, with a strong focus on production readiness. Strong coding depth is non-negotiable.

What You Will Do

- Design and contribute to end-to-end LLM system architecture for real-world enterprise use cases (from requirements to production).
- Pre-train, fine-tune LLMs and domain-specific models using techniques such as CPT, SFT, LoRA, and QLoRA for client-specific use cases.
- Design and run model evaluation pipelines to benchmark performance, accuracy,and cost across different fine-tuning approaches.
- Optimise models for latency, throughput, token efficiency, and inference cost in production environments.
- Work alongside agent orchestration and architecture teams to integrate fine-tuned models into multi-agent pipelines.
- Implement prompt versioning, rollback strategies, and model monitoring to ensure reliability post-deployment.
- Translate business requirements from client engagements into model adaptation strategies with clear success criteria.
- Contribute to internal knowledge sharing on fine-tuning best practices, tooling, and emerging techniques.
- Define enterprise integration patterns for GenAI systems (identity/access controls, auditability, data boundaries, governance, and compliance alignment).
- Improve production reliability: latency/throughput optimization, token efficiency, cost control, and robust failure handling.




- Collaborate with cross-functional stakeholders (engineering, data, product, client teams) to deliver high-impact solutions on tight timelines.
- Contribute hands-on code, perform code reviews, and raise the engineering bar through strong software fundamentals.

Requirements

What We Are Looking For

- 3-6 years of experience in ML engineering, LLMs, or model development roles.
- Hands-on experience with Continual pre-training (CPT), supervised fine-tuning (SFT), LoRA, or QLoRA on LLMs.
- Strong Python programming skills. Ability to write clean, testable, production-ready code.
- Experience running model evaluation and benchmarking pipelines in a structured way.
- Solid understanding of transformer architectures and how fine-tuning affects model behaviour.
- Experience deploying fine-tuned and pre-trained models to cloud environments with attention to cost and latency.
- Strong problem-solving skills with the ability to work independently on client-facing projects.
- Solid software engineering fundamentals: APIs, data structures, testing, debugging, and performance optimization.
- Ability to review designs, communicate trade-offs clearly, and collaborate effectively in a fast-paced environment.
- Experience with AWS-native GenAI building blocks (e.g., Bedrock, OpenSearch, Lambda, ECS/EKS) and secure enterprise deployments.
- Experience with vector databases/search engines (OpenSearch, Pinecone, Weaviate, Milvus, FAISS)



and retrieval optimization.
- Experience with containerization and orchestration (Docker, Kubernetes).
- Experience building evaluation/observability pipelines for LLM systems and implementing safety/guardrail patterns.
- Consulting or client-facing delivery experience.

What Success Looks Like

- The client has a production agentic system that is performing, that their team understands and can operate, and that is producing the outcome that justified the investment.
- OBZ has something reusable from every engagement you touch: a design pattern, an evaluation framework, a deployment runbook, a code module that the next squad picks up without starting from scratch. Your work compounds across the firm, not just within a single account.
- You are a more capable engineer at the end of every engagement than you were at the start. You have pushed into something you had not done before, solved a problem that was not in the playbook, and left evidence of that growth in the IP you contributed and in the engineers you developed alongside you.
- When all three of these are consistently true, you are succeeding at this role.

Certifications

- AWS AI Practitioner, AWS Certified Machine Learning Engineer Associate, AWS Certified Solutions Architect (Associate or Qualified), and Anthropic certification are all relevant and valued. Certification expectations are calibrated to level and assessed during the hiring process.

Job Type

Full time

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Applied AI Engineer (Bengaluru)
🏢 OneByZero
📍 Bengaluru