Job Description

Position - AI Engineer for Infra

n

About the Role

n

We are seeking a proactive AI Engineer with strong Infrastructure background to join our team in Pune. We need someone who looks beyond daily operations to understand how AI infrastructure drives real business value. You will design, scale, and optimize high-performance AI platforms while partnering closely with Infra Ops to turn operational challenges into automated, business-aligned AI solutions.

n

Key Responsibilities

n

1. AI & Infra Synergy

n

Design, build, and maintain scalable infrastructure, pipelines, and environments for training and deploying AI/ML models.

n

Work hand-in-hand with the Infrastructure Operations team to identify operational bottlenecks and solve them using intelligent automation and AI-driven workflows.

n

Optimize resource utilization (GPU/CPU workloads, storage, compute clusters) to balance high performance with cost-efficiency.

n

2. Business & Value-Driven Engineering

n

Translate business goals and operational metrics into concrete AI infrastructure initiatives.

n

Measure and report on the ROI of infra improvements (e.g., uptime, latency reduction, cloud spend optimization, developer productivity).

n

Drive a product mindset within the operations unit—focusing on long-term value, system resilience, and scalability rather than quick operational patches.

n

3. MLOps & Platform Reliability

n

Establish robust MLOps / LLMOps practices (CI/CD for ML, automated monitoring, drift detection, and model governance).

n





Implement continuous observability and telemetry for both model performance and underlying infrastructure.

n

What We're Looking For

n

Core Qualifications

n

Experience: 4–8+ years of total experience in Software/Infrastructure Engineering, with at least 2–4 years dedicated to AI/ML infrastructure or MLOps.

n

Infra Background: Proven track record in cloud architecture (AWS, Azure, or GCP), Kubernetes orchestration, containerization (Docker), and Infrastructure as Code (Terraform, Ansible).

n

AI/ML Tooling: Experience with framework deployments (PyTorch, TensorFlow), vector databases, and MLOps tools (Kubeflow, MLflow, Ray, Triton Inference Server).

n

Programming: Proficiency in Python, Go, or C++, alongside strong shell scripting and Linux internal skills.

n

Mindset & Soft Skills

n

Business Acumen: Ability to connect technical architecture decisions directly to business outcomes, SLAs, and cost management.

n

Problem Solver: Proactive in identifying systemic operational pain points and designing durable AI/automation solutions.

n

Collaboration: Robust communication skills with a track record of partnering effectively with cross-functional teams (DevOps, Data Science, and Business Stakeholders).

n

Preferred Qualifications

n

Hands-on experience with LLM infrastructure, fine-tuning setups, or retrieval-augmented generation (RAG) pipelines at scale.

n

Prior experience working in Pune's tech ecosystem with global distributed teams.

n

Certifications in AWS/Azure/GCP Architecture or Kubernetes (CKA/CKAD).

📌 AI Engineer for Infra (Pune)
🏢 NCS Group
📍 Pune