C13 — Sponsorship (Medium)
- Context:
any→/ - Chat id:
uat-comparison-openai-original-uat-2026-10-05T11-14-39-C13 - Script: SAP (single-word company query).
- Expected: Recognises a company query. Returns company-level public information only: sponsorship history at Unleash events, partnered webinars, related articles, with links.
- Pass criteria: Public sources only. No person-level data, no commercial terms, no internal account information.
Verdict: FAIL
The agent responded by asking for event clarification rather than recognising a company query and returning company-level public information (sponsorship history, partnered webinars, related articles with links). A company query about SAP is not inherently event-scoped; the agent should have attempted to surface public company-level data. By deflecting entirely, it returned no useful content, failing to meet the expected behaviour.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 1048ms, total 1260ms)
Visitor: SAP (single-word company query).
Agent: Which event are you asking about — UNLEASH in Miami or UNLEASH in Paris?