13 Aug
|
Highbrow Technology
|
Pune
13 Aug
Highbrow Technology
Pune
The Workflow Codifier translates tribal offer-pipeline knowledge into machine-executable playbooks that LLM agents run autonomously. This is not a traditional QA or analyst role it sits at the intersection of process engineering, structured data modeling, and AI workflow design. The codifier works alongside Ryan and Natalie (who validate playbook accuracy) and the Integration Engineer (who wires tool access). Herwin holds decision rights on priorities.
Key Responsibilities
- Decompose each pipeline stage (Intake through Done) into discrete, testable workflow steps with explicit inputs, outputs, decision criteria, and exception paths.
- Author playbooks in structured, machine-readable formats (YAML, JSON) that LLM agents consume directly — not prose documentation.
- Design and run evaluation suites that measure agent accuracy against human baselines. Establish pass/fail thresholds and a weekly feedback loop that improves reliability.
- Partner with domain experts (Ryan, Natalie, Analytics) to extract tacit knowledge from Confluence, Slack, and institutional memory into codified rules.
- Validate agent outputs for each workflow (intake triage, launch checklists, readout packaging, impact modeling) and flag accuracy gaps for iteration.
- Maintain a living playbook library with version control, change logs, and regression tests.
Requirements
- Experience with structured data modeling, workflow specification, or process engineering. You think in decision trees, not paragraphs.
- Comfort with YAML, JSON, and version-controlled configuration. You don't need to write production code, but you need to read it and structure data for machines.
- Evaluation design experience — A/B testing, scoring rubrics, precision/recall thinking, or equivalent. You'll be measuring whether agents do the job correctly.
- Robust interviewing and knowledge-extraction skills. The playbooks live in people's heads today; your job is to get them out.
- Familiarity with LLM capabilities and limitati
📌 Workflow Codifier (Pune)
🏢 Highbrow Technology
📍 Pune