Role Overview: Lead the development of the application layer for enterprise GenAI solutions. Connect LLM backends to scalable frontends while managing API gateways and cloud deployments.
Responsibilities
Key Responsibilities
- Application Architecture: Design scalable microservices that handle LLM requests, streaming responses (Server-Sent Events), and context management.
- Cloud & DevOps: Oversee the deployment of AI applications on AWS, Azure, or GCP.
- Integrate CI/CD pipelines for AI software components.
- Frontend & Backend Integration: Ensure seamless, low-latency integration between contemporary frontends (React/Next.js) and Python/FastAPI backends running AI models.