Infrastructure - Linux / HPC Engineer AI & ML Platforms:

We are seeking a highly skilled Linux / HPC Infrastructure Engineer to support and scale enterprise AI/ML and LLM platforms across GPU clusters, Kubernetes environments, and data center infrastructure.

This role combines expertise in Linux systems, Kubernetes administration, HPC infrastructure, GPU-accelerated AI workloads, and enterprise platform operations.

You will be responsible for designing, deploying, optimizing, and maintaining highly available AI infrastructure environments supporting large-scale inference, distributed computing, and cloud-native AI platforms.

Key Responsibilities:

- Deploy, manage, and optimize AI/ML and LLM inference workloads across GPU clusters, HPC infrastructure, and cloud environments.
- Build and maintain scalable AI platform infrastructure using Kubernetes, containers, and enterprise orchestration platforms.
- Administer and optimize Linux servers including system configuration, patching, security hardening, performance tuning, and troubleshooting.
- Manage physical infrastructure including servers, storage, networking, and bare-metal environments within enterprise data centers.
- Implement and maintain CI/CD and automation workflows for platform and infrastructure deployments.
- Optimize infrastructure performance, GPU utilization, resource allocation, and distributed workloads to meet operational requirements.
- Benchmark and evaluate AI workloads for scalability, latency, throughput, and resource efficiency.
- Collaborate with infrastructure, SRE, and platform engineering teams to provision compute resources and maintain enterprise-scale AI environments.
- Implement monitoring, logging,



observability, and alerting solutions for platform reliability and operational visibility.
- Apply security patches, upgrades, compliance controls, and operational best practices for Linux and Kubernetes environments.
- Troubleshoot issues across hardware, networking, operating systems, Kubernetes clusters, and AI/ML workloads.
- Support enterprise operations through efficient incident, change, and ticket management processes.
- Automate infrastructure operations using scripting and infrastructure automation tools.

Required Qualifications:

- 8+ years of experience in Linux systems administration, cloud-native infrastructure, HPC environments, or platform engineering.
- At least 4 years of experience supporting AI/ML workloads or large-scale distributed compute environments in production.
- Comfortable leveraging AI-assisted tools for collaborative development, code generation, refactoring, and productivity enhancement.
- Strong hands-on expertise with Linux administration (RHEL, Ubuntu, or similar).
- Experience with Kubernetes administration, container orchestration, and cloud-native infrastructure platforms.
- Strong understanding of GPU infrastructure, distributed computing, and HPC systems.
- Hands-on experience with bare-metal infrastructure, servers, storage systems,



and enterprise networking.
- Strong understanding of networking fundamentals including TCP/IP, DNS, load balancing, and firewalls.
- Experience with scripting and infrastructure automation with Bash, Python etc.
- Experience with CI/CD, DevOps, or infrastructure deployment workflows.
- Experience with monitoring, observability, and logging platforms.
- Strong troubleshooting and performance optimization skills across Linux, Kubernetes, networking, and infrastructure stacks.
- Excellent problem-solving, communication, and collaboration skills.
- Ability to work effectively in quick-paced, mission-critical production environments.

Ways to Stand Out from the Crowd:

- Experience with OpenShift or large-scale Kubernetes platform operations.
- Hands-on experience supporting AI/ML and LLM inference platforms at scale, including working with vLLM for high-performance LLM serving, optimization, and large-scale inference.
- Experience with infrastructure-as-code, GitOps, or advanced automation frameworks.
- Proficiency with Python, Bash, Ansible, Jenkins, Git, ArgoCD, or similar DevOps tooling.
- Experience with GPU performance tuning, distributed AI workloads, or HPC optimization.
- Familiarity with observability platforms such as Prometheus, Grafana, ELK/Elasticsearch, or distributed tracing systems.
- Experience supporting enterprise AI infrastructure in hybrid cloud or large-scale data center environments.
- Familiarity with Juniper networking environments or enterprise network operations.
- RHCSA/RHCE, CKA/CKS, or similar infrastructure/platform certifications.

📌 Infrastructure Support Engineer (Pune)
🏢 Emergys Software
📍 Pune