Company Name: VARITE India Private Limited

About The Client:

Client is a Japanese multinational conglomerate specializing in power systems, social infrastructure, electronic devices, digital solutions, and more, with a diverse product range including medical equipment, semiconductors, and industrial systems. Founded in 1875 and formally incorporated in 1939, Toshiba has evolved from its origins in electronics and electrical manufacturing to become a global leader in creative technology and systems across numerous sectors.
About The Job:
- We are looking for an engineer experienced in deploying and optimizing Large Language Models on edge devices, preferably NVIDIA Jetson platforms.
- The role is not limited to model inference; the candidate should be able to design practical LLM-based solutions for real-world scenarios using prompt engineering, input preprocessing, caching strategies, data creation, and model fine-tuning when required.
- The ideal candidate should understand how to make LLM applications reliable, efficient,



and context-aware under edge-device constraints such as limited compute, memory, latency, and power.

Qualifications:

Mandatory Skills
- Hands-on experience with LLMs, prompt engineering, and scenario-specific prompt design.
- Experience running AI/ML models on edge devices with compute and memory constraints.
- Practical knowledge of preprocessing techniques for text, speech transcripts, and structured inputs.
- Experience implementing caching, context management, and optimization techniques for LLM applications.
- Ability to create datasets and fine-tune or adapt models for domain-specific use cases.
- Strong Python programming skills.
- Understanding of NLP tasks such as intent handling, entity extraction, and text classification.
- Experience with model evaluation, latency optimization, and debugging AI behavior.
- Familiarity with NVIDIA Jetson or similar edge AI platforms.

Good to Have Skills
- Experience with speech processing, speec

📌 Edge LLM Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru