CategoryPlatforms / Frameworks / ToolsProgramming &
• APIsPython, FastAPI, REST APIs, Pydantic, pytestAgent OrchestrationLangGraph, LangChain, OpenAI Agents SDK, Google ADK, Pydantic-AIAgent ObservabilityOpenTelemetry, OpenInference, Langfuse, LangSmithLLM Evaluation, Experiment LifecycleMLflow Evaluation, DeepEval, Ragas, promptfoo, custom pytest evaluationsAzure AI StackAzure OpenAI, Microsoft Foundry, Azure Monitor, Application InsightsDatabricksUnity Catalog, Databricks Workflows/Jobs, SQL WarehousesCI/CD &
• Version ControlGit, Gitlab, automated testing pipelinesProduction MonitoringGrafana, Prometheus, Azure Monitor, Kibana, alerting platformsCloud &
• ContainersDocker, Kubernetes, AKS, Terraform/BicepSecurity &
• IdentityMicrosoft Entra ID, managed identities, OAuth2, Key Vault, RBACCategoryPlatforms / Frameworks / ToolsProgramming &
• APIsPython, FastAPI, REST APIs, Pydantic,
pytestAgent OrchestrationLangGraph, LangChain, OpenAI Agents SDK, Google ADK, Pydantic-AIAgent ObservabilityOpenTelemetry, OpenInference, Langfuse, LangSmithLLM Evaluation, Experiment LifecycleMLflow Evaluation, DeepEval, Ragas, promptfoo, custom pytest evaluationsAzure AI StackAzure OpenAI, Microsoft Foundry, Azure Monitor, Application InsightsDatabricksUnity Catalog, Databricks Workflows/Jobs, SQL WarehousesCI/CD &
• Version ControlGit, Gitlab, automated testing pipelinesProduction MonitoringGrafana, Prometheus, Azure Monitor, Kibana, alerting platformsCloud &
• ContainersDocker, Kubernetes, AKS, Terraform/BicepSecurity &
• IdentityMicrosoft Entra ID, managed identities, OAuth2, Key Vault, RBAC
📌 Agent Evaluation & Operations Engineer (Pune)
🏢 NCSi
📍 Pune