Location: Bengaluru, India

Company: QFocus India Pvt. Ltd.

Domain: Embedded software

Description We are seeking an experienced Embedded AI Engineer to join our team in validating PyTorch-based Large Language Models (LLMs) using CUDA SDK APIs. The successful candidate will be responsible for debugging, extending and replacing the underlying CUDA code to ensure seamless functionality on our company-specific AI processors.

Key Responsibilities
Validate PyTorch-based LLMs on company-specific AI processors using CUDA SDK APIs
Debug and troubleshoot issues related to CUDA code integration with PyTorch models
Extend and modify CUDA code to optimize performance on company-specific AI processors
Replace existing CUDA code with custom implementations to meet specific requirements
Collaborate with cross-functional teams to ensure successful integration of LLMs with company-specific AI processors
Develop and maintain validation frameworks and tools for PyTorch-based LLMs




Analyze and optimize the performance of LLMs on company-specific AI processors

Requirements
Bachelor's or Master's degree in Computer Science, Electrical Engineering or related fields
Robust experience with CUDA programming and PyTorch framework
In-depth knowledge of deep learning models, particularly Large Language Models (LLMs)
Proficiency in C++ and Python programming languages
Experience with debugging and troubleshooting complex software issues
Excellent problem-solving skills and attention to detail
Solid communication and collaboration skills

Nice to Have
Experience with AI processor architecture and design
Knowledge of other deep learning frameworks, such as TensorFlow

QFocus AI Pvt. Ltd. is an Equal Employment Prospect employer. Back to Careers

📌 Ai/ml Cuda Engineer Bengaluru
🏢 QFocus Technologies
📍 Bengaluru