Description
We are seeking an experienced Embedded AI Engineer to join our team in validating PyTorch-based Large Language Models (LLMs) using CUDA SDK APIs. The successful candidate will be responsible for debugging, extending and replacing the underlying CUDA code to ensure seamless functionality on our company-specific AI processors.
Key Responsibilities
Validate PyTorch-based LLMs on company-specific AI processors using CUDA SDK APIs
Debug and troubleshoot issues related to CUDA code integration with PyTorch models
Extend and modify CUDA code to optimize performance on company-specific AI processors
Replace existing CUDA code with custom implementations to meet specific requirements
Collaborate with cross-functional teams to ensure successful integration of LLMs with company-specific AI processors
Develop and maintain validation frameworks and tools for PyTorch-based LLMs
Analyze and optimize the performance of LLMs on company-specific AI processors
Requirements
Bachelor's or Master's degree in Computer Science, Electrical Engineering or related fields
Solid experience with CUDA programming and PyTorch framework
In-depth knowledge of deep learning models, particularly Large Language Models (LLMs)
Proficiency in C++ and Python programming languages
Experience with debugging and troubleshooting complex software issues
Excellent problem-solving skills and attention to detail
Solid communication and collaboration skills Nice to Have
Experience with AI processor architecture and design
Knowledge of other deep learning frameworks, such as TensorFlow
📌 Ai Ml Cuda Engineer Bengaluru
🏢 SproutsAI
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.