Senior DevOps Engineer:

Company: Ethara AI

Location: 5th Floor, Plot No. 273, Udyog Vihar II Road, Udyog Vihar Phase 1, Sector 20, Gurugram, Haryana 122016

Employment Type: Full-Time

Experience Required: 5+ Years

Role Overview

We are looking for a highly skilled Senior DevOps Engineer with strong expertise in cloud infrastructure, containerization, and automation. In this role, you will be responsible for designing, deploying, and managing scalable, secure, and high-performance infrastructure that supports AI-driven platforms and production-grade systems.

You will play a key role in driving DevOps maturity, implementing best practices, and enabling seamless deployment and observability across distributed systems.

Key Responsibilities

- Design and manage scalable, secure cloud infrastructure on AWS, including VPC, IAM, EC2, S3, RDS, ECR, Route 53, and Secrets Manager
- Build and maintain Infrastructure as Code (IaC) using Terraform, Pulumi, or AWS CDK
- Develop and manage CI/CD pipelines using Git, GitHub Actions, Jenkins, and ArgoCD with GitOps practices
- Design, build, and optimize containerized applications using Docker , including image creation, multi-stage builds, and runtime optimization, and deploy them on Kubernetes (EKS) using Helm, HPA, RBAC, and IRSA
- Own end-to-end container lifecycle management , including image optimization, security hardening, versioning, and efficient deployment across environments
- Implement advanced Kubernetes capabilities such as Karpenter, Istio service mesh, mTLS, and canary deployments
- Set up and manage observability and monitoring systems using CloudWatch, Prometheus, Grafana, Loki, and OpenSearch
- Design and manage streaming and messaging systems using Kafka, MSK, and Schema Registry
- Ensure robust security practices, including IAM policies, container security, TLS/SSL, and shift-left security approaches
- Handle incident management, perform root cause analysis (RCA), and improve system reliability
- Optimize infrastructure for cost, performance,



and scalability
- Collaborate with engineering and AI teams to support LLM infrastructure and deployment workflows, including AWS Bedrock integration

Required Skills & Qualifications

- 5+ years of experience in DevOps / Cloud / Infrastructure Engineering
- Strong hands-on experience with AWS services: VPC, IAM, EC2, S3, RDS, ECR, Route 53, Secrets Manager
- Strong hands-on experience with Docker , including containerization, image optimization, multi-stage builds, and debugging containerized environments
- Deep expertise in Kubernetes (EKS), including Helm, HPA, RBAC, IRSA, Karpenter, and Istio
- Strong experience with CI/CD tools: Git, GitHub Actions, Jenkins, ArgoCD
- Hands-on experience with Infrastructure as Code tools such as Terraform (preferred), Pulumi, or AWS CDK
- Experience with monitoring and observability tools: CloudWatch, Prometheus, Grafana, Loki, OpenSearch
- Working knowledge of Kafka/MSK and distributed streaming systems
- Strong understanding of Linux systems, networking, DNS, TLS/SSL, ALB/NLB
- Proficiency in scripting (Python and/or Bash)
- Strong understanding of security best practices (IAM, RBAC, container security)
- Experience in incident management and reliability engineering

Preferred / Bonus Skills

- Experience with AWS Bedrock and AI/ML infrastructure
- Familiarity with service mesh (Istio) and mTLS architectures
- Exposure to MLOps tools such as Kubeflow or MLflow
- Proven experience in cost optimization at scale
- Prior experience working in AI/LLM-driven environments

Certifications (Preferred)

- AWS Solutions Architect certifications
- Certified Kubernetes Administrator (CKA) or Developer (CKAD)
- Terraform Associate Certification
- DevSecOps or Security+ Certification

Why Join Us

- Work on cutting-edge AI/ML infrastructure and LLM systems
- Design and scale production-grade distributed systems
- Be part of a high-growth, high-impact engineering team
- Prospect to shape DevOps architecture and best practices
- Competitive compensation and continuous learning opportunities

📌 Sr. DevOps Engineer (Gurugram)
🏢 Ethara AI
📍 Gurugram