Grid Dynamics is seeking an AI Expert (Senior Engineer) to spearhead the development of local Large Language Models (LLMs) for Personally Identifiable Information (PII) detection across our vast data ecosystem. This role involves building and fine-tuning custom LLMs that can identify PII in documents, databases, knowledge graphs, source code, and other knowledge-sharing platforms. The models must effectively handle data at scale (50+ PB of data) and remain up-to-date with continuous retraining on a quarterly or monthly basis.
As the AI Senior Engineer, you will design and implement these AI solutions using technologies like Ray, llama.cpp, ollama, vLLM, and PyTorch, deploying them on Azure cloud and on-premises infrastructure for efficient, large-scale operation. You will also develop generative AI agents that leverage data schemas and metadata to improve PII detection accuracy. Collaboration is key: you will work closely with data engineering, security, and compliance teams to ensure the AI models meet business requirements and align with industry regulations (GDPR, CCPA, PCI DSS,



etc.).
Essential functions
- Design, train, fine-tune, and optimize local LLMs or other NLP models for PII detection across diverse data types (documents, databases, knowledge graphs, code, and other knowledge-sharing formats).
- Develop generative AI agents (on Autogen/Langgraph) for schema- and metadata-based PII detection to enhance identification of sensitive data.
- Work with cutting-edge AI frameworks (Ray, llama.cpp, ollama, vLLM, PyTorch) to deploy and scale models efficiently in a distributed setting.
- Implement and optimize AI/ML solutions on Azure cloud and on-premise infrastructure, ensuring high performance and reliability.
- Collaborate with data engineering, security, and compliance teams to align AI solutions with business needs and regulatory requirements.
- Lead a small team of AI engineers, providing mentorship, code reviews, and technical guidance to drive project

📌 Senior GenAI Engineer (Bengaluru)
🏢 Grid Dynamics
📍 Bengaluru