AI Engineer For Infra

Start Date

Starts Immediately

CTC (ANNUAL)

Competitive salary Market-competitive salary

Experience

2 year(s)

2 year(s)

Apply By

Not Provided

Posted today

Job

Be an early applicant

About the job

Position - AI Engineer for Infra

About the Role

We are seeking a proactive AI Engineer with strong Infrastructure background to join our team in Pune. We need someone who looks beyond daily operations to understand how AI infrastructure drives real business value. You will design, scale, and optimize high-performance AI platforms while partnering closely with Infra Ops to turn operational challenges into automated, business-aligned AI solutions.

Key Responsibilities

1. AI & Infra Synergy

Design, build, and maintain scalable infrastructure, pipelines, and environments for training and deploying AI/ML models.

Work hand-in-hand with the Infrastructure Operations team to identify operational bottlenecks and solve them using intelligent automation and AI-driven workflows.

Optimize resource utilization (GPU/CPU workloads, storage, compute clusters) to balance high performance with cost-efficiency.

2. Business & Value-Driven Engineering

Translate business goals and operational metrics into concrete AI infrastructure initiatives.

Measure and report on the ROI of infra improvements (e.g., uptime, latency reduction, cloud spend optimization, developer productivity).

Drive a product mindset within the operations unitfocusing on long-term value, system resilience, and scalability rather than quick operational patches.

3. MLOps & Platform Reliability

Establish robust MLOps / LLMOps practices (CI/CD for ML, automated monitoring, drift detection, and model governance).

Implement continuous observability and telemetry for both model performance and underlying infrastructure.

What Were Looking For

Core Qualifications

Experience: 48+ years of total experience in Software/Infrastructure Engineering,



with at least 24 years dedicated to AI/ML infrastructure or MLOps.

Infra Background: Proven track record in cloud architecture (AWS, Azure, or GCP), Kubernetes orchestration, containerization (Docker), and Infrastructure as Code (Terraform, Ansible).

AI/ML Tooling: Experience with framework deployments (PyTorch, TensorFlow), vector databases, and MLOps tools (Kubeflow, MLflow, Ray, Triton Inference Server).

Programming: Proficiency in Python, Go, or C++, alongside strong shell scripting and Linux internal skills.

Mindset & Soft Skills

Business Acumen: Ability to connect technical architecture decisions directly to business outcomes, SLAs, and cost management.

Problem Solver: Proactive in identifying systemic operational pain points and designing durable AI/automation solutions.

Collaboration: Strong communication skills with a track record of partnering effectively with cross-functional teams (DevOps, Data Science, and Business Stakeholders).

Preferred Qualifications

Hands-on experience with LLM infrastructure, fine-tuning setups, or retrieval-augmented generation (RAG) pipelines at scale.

Prior experience working in Punes tech ecosystem with global distributed teams.

Certifications in AWS/Azure/GCP Architecture or Kubernetes (CKA/CKAD).

Earn certifications in these skills

+ 6 more skills

Who can apply

Only those candidates can apply who:

1. have minimum 2 years of experience

Salary

Probation:

Duration:

Salary during probation:

After probation:

Annual CTC: Competitive salary

Number of openings

1

Editor’s note

Information above is Internshala's interpretation and paraphrasing of what we found on the shared link.

Additional Questions

Sign up to continue

Candidate sign up

Sign up/ Login with Google

Sign up with Email

OR

By continuing as a candidate, you agree to our T&C; .

Already registered? Login

Sign up to continue

Candidate sign up

Sign up/ Login with Google

Sign up with Email

OR

By continuing as a candidate, you agree to our T&C; .

Already registered? Login

📌 AI Engineer For Infra (Maharashtra)
🏢 NCS Group
📍 Maharashtra