- Experience Range: 4–8 Years | Location: Bangalore / Remote

Position Overview

As an MLOps and AI Infrastructure Engineer, you sit at the intersection of software engineering, data science, and cloud operations. You will be responsible for building, scaling, and optimizing the underlying pipelines, model-serving architectures, and infrastructure required to run large-scale machine learning and generative AI workloads efficiently in production.

Key Responsibilities & Scope

- Model Deployment & Serving: Architect and maintain scalable model deployment pipelines for LLMs, deep learning models, and predictive analytics engines using tools like Triton, Ray, or BentoML.

- Pipeline Automation: Build automated CI/CD pipelines for machine learning (ML pipelines) covering data ingestion, feature stores, model training, validation, and monitoring.

- Infrastructure Cost & GPU Optimization:



Monitor GPU/CPU cluster utilization, manage container orchestration (Kubernetes), and optimize cloud compute expenditures for heavy AI workloads.

- Collaboration: Work closely with Data Scientists and AI Researchers to transition experimental models into resilient, low-latency production services.

Must-Have Qualifications

- Experience: 4–8 years of experience in cloud infrastructure, DevOps, or backend engineering with a heavy focus on ML systems.

- Tech Stack: Deep proficiency in Python, Docker, Kubernetes, Terraform, and cloud platforms (AWS Bedrock, SageMaker, GCP Vertex AI, or similar).

- Domain Expertise: Hands-on familiarity with vector databases (Pinecone, Milvus, Qdrant) and LLM orchestration frameworks.

📌 MLOps / AI Infrastructure Engineer (India)
🏢 HyrEzy Talent Solutions
📍 India