Job Summary

We are seeking a ML Infrastructure Engineer that will be responsible for designing, building, and operating the infrastructure that supports Generative AI and machine learning workloads in production. This role ensures performance, scalability, reliability, and cost efficiency of AI systems.

Location

Bangalore, India (Hybrid; 3 days onsite/2 days remote)

Responsibilities

- Design and operate infrastructure for training, serving, and scaling machine learning and Generative AI models
- Build and optimize model serving and inference pipelines for Large Language Models
- Enable scalable experimentation, evaluation, and deployment of AI models
- Implement monitoring, logging, and alerting for AI infrastructure and model performance
- Collaborate with AI, data, and DevOps teams to ensure end-to-end system reliability
- Design and maintain scalable infrastructure for AI and ML workloads
- Optimize inference performance, resource utilization, and operational costs
- Implement observability solutions for model and infrastructure health
- Partner with AI engineers to productionize models and workflows
- Identify infrastructure risks and drive improvements proactively

What We're Looking For




- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 6-9 years of experience in infrastructure, platform, or ML engineering roles
- Experience supporting production AI or data-intensive systems at scale
- Hands-on experience with cloud platforms and up-to-date infrastructure tooling
- Strong experience with cloud platforms and cloud-native infrastructure
- Hands-on experience with containerization and orchestration technologies
- Experience deploying and scaling ML or AI model serving systems
- Strong understanding of performance optimization, cost management, and reliability engineering
- Familiarity with CI/CD pipelines and infrastructure automation

Attributes of a Successful HYCUer in this role
- Self-starter and strategic thinker who thinks outside the box

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 ML Infrastructure Engineer - Level 4 (Bengaluru)
🏢 Hycu
📍 Bengaluru