19 Nov
|
Recruitingbond
|
Hyderabad
19 Nov
Recruitingbond
Hyderabad
Senior Infrastructure Engineer/SRE/Platform Engineer – AWS EKS, Kubernetes & AI Infrastructure
Location: Hyderabad, India
Employment Type: Full-Time
Experience: 4–8 Years
Job Function: Cloud Infrastructure | Platform Engineering | DevOps | SRE
Industry: Healthcare AI | Agentic AI | AI SaaS
About the Role
We are looking for a highly hands-on Senior Platform Engineer – AWS EKS & AI Infrastructure to design, build, automate and operate scalable, secure and cost-efficient cloud infrastructure powering next-generation AI-driven healthcare applications.
In this role, you will take ownership of production-grade AWS infrastructure, Kubernetes platforms, Infrastructure as Code (IaC), deployment automation, observability and reliability engineering.
You will collaborate closely with AI/ML engineers, backend engineers, security teams and product engineering to build and scale infrastructure supporting real-time healthcare workflows, LLM-powered applications, agentic AI systems and GPU-intensive workloads.
We are looking for an engineer who goes beyond deploying applications onto Kubernetes — someone who understands how to architect, provision, configure, troubleshoot, optimize and operate the underlying infrastructure.
Key Responsibilities:
1. AWS Cloud Infrastructure & Architecture
- Design, build and operate scalable, highly available and secure AWS infrastructure for production workloads.
- Provision and manage AWS services including EKS, EC2, VPC, IAM, ALB/NLB, Route 53, S3, EBS, EFS, RDS, ElastiCache and CloudWatch.
- Architect VPC networking, subnets, routing, security groups, NAT gateways, load balancing and private connectivity.
- Implement multi-environment and multi-account cloud infrastructure.
- Design infrastructure for high availability, disaster recovery, fault tolerance and business continuity.
2. Kubernetes & Amazon EKS Engineering
- Design, provision, configure and manage production-grade Amazon EKS clusters.
- Own Kubernetes cluster architecture, node groups, networking, storage, upgrades and lifecycle management.
- Implement advanced Kubernetes scheduling, workload orchestration and resource optimization.
- Configure Karpenter, Cluster Autoscaler, HPA, VPA and KEDA for intelligent workload scaling.
- Implement Kubernetes RBAC, Network Policies, Pod Security, resource quotas and multi-tenancy.
- Troubleshoot complex Kubernetes issues involving networking, DNS, storage, node failures, pod scheduling and performance.
- Develop reusable deployment patterns using Helm, Kubernetes manifests and Operators.
3. Infrastructure as Code & Automation
- Develop and maintain reusable Infrastructure as Code modules using Terraform.
- Implement Terragrunt for managing multi-environment and multi-account infrastructure.
- Automate infrastructure provisioning, configuration, upgrades, scaling and decommissioning.
- Develop infrastructure automation using Python, Go or Bash.
- Implement infrastructure validation, configuration management, drift detection and policy-as-code.
- Establish standardized, reusable infrastructure provisioning frameworks.
4. GitOps, CI/CD & Platform Engineering
- Implement GitOps-based deployment and infrastructure management using Argo CD.
- Build and maintain deployment workflows using Helm, Kustomize and Kubernetes.
- Develop CI/CD pipelines using GitHub Actions, GitLab CI, Jenkins or equivalent platforms.
- Implement automated deployment, rollback, canary and blue-green release strategies.
- Establish self-service infrastructure provisioning and developer enablement workflows.
5. Site Reliability Engineering & Observability
- Define and implement SLIs, SLOs and reliability engineering practices.
- Build observability solutions using Prometheus, Grafana, OpenTelemetry, Loki, ELK/EFK or equivalent tools.
- Implement centralized logging, distributed tracing, monitoring and intelligent alerting.
- Lead technical troubleshooting, incident response, root cause analysis and post-incident reviews.
- Improve infrastructure availability, performance, resilience and Mean Time to Recovery (MTTR).
- Develop automated remediation and self-healing infrastructure capabilities.
6. AI/ML & GPU Infrastructure
- Build and operate cloud infrastructure supporting production AI/ML inference and LLM-powered applications.
- Support Kubernetes-based GPU workload orchestration and scalable model-serving infrastructure.
- Work with NVIDIA GPU infrastructure, GPU-enabled EC2 instances, GPU scheduling and resource allocation.
- Support AI inference frameworks such as vLLM, NVIDIA Triton, KServe or equivalent.
- Optimize infrastructure for GPU utilization, inference latency, throughput and operational efficiency.
- Collaborate with AI/ML engineering teams to support LLM deployment pipelines and agentic AI workloads.
7. Cloud Cost Optimization & Security
- Optimize AWS infrastructure costs through resource right-sizing, intelligent autoscaling and workload scheduling.
- Implement EKS cost optimization using Karpenter, Spot Instances, Graviton and resource utilization strategies.
- Implement cost monitoring using AWS Cost Explorer, Kubecost, OpenCost or equivalent.
- Establish cloud security practices covering IAM, workload identity, secrets management and network security.
- Support compliance requirements including HIPAA and SOC 2.
- Implement container image scanning, SBOM generation, vulnerability management and software supply-chain security.
Required Technical Skills
- AWS: Strong hands-on production experience with AWS cloud infrastructure, particularly Amazon EKS, EC2, VPC, IAM and networking.
- Kubernetes: Advanced understanding of Kubernetes architecture, cluster provisioning, lifecycle management, autoscaling and troubleshooting.
- Terraform: Solid experience building reusable Infrastructure as Code modules.
- Terragrunt: Experience managing multi-environment infrastructure is highly desirable.
- Karpenter: Practical experience with Kubernetes node provisioning, autoscaling and optimization.
- GitOps: Hands-on experience with Argo CD, Helm and Kubernetes deployment automation.
- Programming & Scripting: Python, Go or Bash for infrastructure automation.
- Observability:
Prometheus, Grafana, OpenTelemetry, centralized logging and monitoring.
- SRE: Production incident management, RCA, SLOs, reliability and performance engineering.
- Cloud Optimization: Understanding of AWS cost optimization, infrastructure right-sizing and resource efficiency.
Good to Have
- AWS EKS Blueprints, AWS Organizations and multi-account architecture.
- Kubernetes Operators, Custom Resource Definitions (CRDs) and Crossplane.
- NVIDIA GPU Operator, CUDA, vLLM, KServe and GPU infrastructure.
- KEDA, Cilium, Calico, Istio and service mesh architectures.
- OPA Gatekeeper, Kyverno and policy-as-code.
- Vault, External Secrets Operator and AWS Secrets Manager.
- Kubecost, OpenCost and FinOps practices.
- GCP/GKE or multi-cloud infrastructure experience.
- Experience supporting healthcare, AI/ML, LLM or high-scale SaaS workloads.
Experience & Candidate Profile
- 4–8 years of relevant experience in DevOps, SRE, Cloud Infrastructure, Platform Engineering or Infrastructure Engineering.
- Demonstrated hands-on experience building and managing production AWS infrastructure.
- Strong practical experience provisioning and operating Amazon EKS clusters.
- Experience designing Kubernetes infrastructure rather than only deploying applications onto existing clusters.
- Proven experience with Terraform-based infrastructure provisioning and automation.
- Strong understanding of cloud networking, security, scalability and high availability.
- Experience handling production incidents, troubleshooting complex infrastructure issues and improving system reliability.
- Ability to demonstrate measurable improvements in infrastructure performance, automation, scalability or cloud costs.
- Robust ownership, problem-solving and cross-functional collaboration skills.
What Makes You a Good Fit?
We are particularly interested in engineers who have:
- Built AWS EKS clusters and infrastructure from the ground up.
- Implemented Karpenter and advanced Kubernetes autoscaling.
- Designed reusable Terraform/Terragrunt infrastructure modules.
- Established GitOps deployment workflows using Argo CD.
- Solved complex production Kubernetes and cloud infrastructure challenges.
- Delivered measurable AWS infrastructure cost optimization.
- Supported GPU-backed workloads, AI inference or LLM infrastructure in production.
This is a hands-on individual contributor engineering role. We value actual implementation, technical ownership and production experience over tool familiarity or certifications alone.
Why Join Us?
- Build infrastructure powering next-generation healthcare AI and agentic AI products.
- Work on real-world LLM, voice AI, conversational AI and GPU-intensive workloads.
- Take ownership of critical cloud architecture and platform engineering decisions.
- Collaborate with AI-native engineering teams using Claude Code, Cursor, GitHub Copilot and modern development tools.
- Work in a high-ownership, rapid-moving startup environment.
- Collaborate with engineering and leadership teams across India and the USA.
- Be part of an ambitious team scaling from Seed to Series A.
Interested in building the infrastructure behind the next generation of AI-powered healthcare? We would love to hear from you.
📌 Senior Infrastructure Engineer/SRE/Platform Engineer,/Level (Hyderabad)
🏢 Recruitingbond
📍 Hyderabad