Job Description:
Design RAG/LLM pipelines for experiment management, model management, feature management, and model retraining.
Design APIs for model inferencing at scale.
Proven expertise with MLflow, SageMaker, Vertex AI, and Azure AI.
LLM Serving & GPU Architecture: Deep knowledge of GPU architectures, distributed training, and serving of large language models.
Model Fine-Tuning & Optimization: Improve latencies, accuracies, and reduce resource requirements for fine-tuning LLM/LVM models.
DevOps & LLMOps Proficiency: Expertise in Kubernetes, Docker, container orchestration, and LLM orchestration frameworks (Flowise, Langflow, Langgraph).
Mandatory Skill Sets
Gen AI, LLM, Hugging Face
Python, PyTorch/TensorFlow/Keras
Langchain, Langgraph
Docker, Kubernetes
Additional Skills
Databases/Datawarehouse: DynamoDB, Cosmos, MongoDB, RDS, MySQL, PostgreSQL, Aurora, Spanner, BigQuery
Cloud Knowledge: AWS, Azure, GCP
DevOps Tools: FluentD, Kibana, Grafana, Prometheus
Proficient in Python, SQL, JavaScript

📌 Ai Architect Bengaluru
🏢 Acme Services Private
📍 Bengaluru