20 Nov
|
Stratsol Software Systems
|
Chennai
20 Nov
Stratsol Software Systems
Chennai
Job Title: Senior Storage Engineer – AI/ML & HPC Infrastructure
Location:
Chennai, India
Experience:
7–12 Years Work Mode: Onsite/Hybrid
About the Role
We are seeking an experienced Senior Storage Engineer to design, implement, optimize, and support enterprise-scale distributed storage infrastructure powering NVIDIA GPU clusters, AI/ML workloads, LLM training, inference, and high-performance computing (HPC). Must-Have Skills
• Parallel File Systems: Lustre, BeeGFS, Ceph, GPFS (IBM Spectrum Scale), and NFS.
• Storage Technologies: NVMe-oF, S3 Object Storage, Scratch/HPS, and parallel storage architecture.
• AI/HPC Infrastructure: NVIDIA GPU clusters, GPUDirect Storage (GDS), LLM training/inference, and AI data pipelines.
• Storage Architecture: Namespace management, OST/MDT layouts, striping, RAID policies, and warm/cold storage tiering.
• Performance Optimization: RDMA, page cache, I/O schedulers, metadata contention, small-file handling, and I/O latency troubleshooting.
• Monitoring & Automation: fio, fs-digests, Prometheus, Grafana, Ansible, and Lustre/BeeGFS tooling.
• Incident Management: P0/P1 incident response, root cause analysis (RCA), filesystem corruption, capacity exhaustion, hardware failures, and split-brain recovery.
• Backup & DR: Snapshots, checkpoint retention, failover testing, restore validation,
RPO/RTO, and disaster recovery exercises.
• Storage Security: POSIX permissions, ACLs, S3 policies, encryption at rest/in transit, retention, and legal holds.
Key Responsibilities
• Design and expand high-throughput Lustre/BeeGFS, NVMe-oF, and S3 storage tiers.
• Support large-scale AI training data ingestion, checkpoints, and inference artifacts.
• Perform storage capacity planning, performance tuning, rebalancing, and failover testing.
• Identify and resolve metadata bottlenecks, I/O latency spikes, and storage performance issues.
• Lead critical P0/P1 incidents impacting NVIDIA GPU clusters and enterprise AI/ML workloads.
• Conduct detailed RCA and implement preventive measures.
• Monitor sustained/peak throughput, metadata operations latency, job I/O stall rates, and restore drill success.
• Maintain storage reliability, security, backup, and disaster recovery readiness. Qualifications
• BE/B-Tech or equivalent in Computer Science or Electronics & Communication.
• 7–12 years of distributed storage experience, including hands-on experience with Lustre/BeeGFS/Ceph, NVMe-oF, and S3 in GPU environments. Preferred Certifications
• SNIA
• NetApp, Dell, or VAST vendor certifications
📌 Senior Storage Engineer – AI/ML (Chennai)
🏢 Stratsol Software Systems
📍 Chennai