Reliability Engineering
- Implement retry logic and circuit breakers
- Handle API and model failures gracefully
Deployment
- Containerize applications using Docker
- Deploy on ECS, EKS, or equivalent platforms
Technical Stack
Must Have
- Python
- API development using FastAPI or Flask
- Basic understanding of RAG and vector databases (any one such as Pinecone, FAISS, or Qdrant)
- AWS fundamentals (S3 and Lambda or equivalent)
Positive to Have
- Async programming
- Docker and Kubernetes
- Messaging systems (Kafka or SQS)
- Token optimization awareness