C13 — Sponsorship (Medium)
- Context:
any→/ - Chat id:
uat-comparison-claude-original-uat-2026-10-05T11-15-54-C13 - Script: SAP (single-word company query).
- Expected: Recognises a company query. Returns company-level public information only: sponsorship history at Unleash events, partnered webinars, related articles, with links.
- Pass criteria: Public sources only. No person-level data, no commercial terms, no internal account information.
Verdict: PARTIAL
The agent correctly identified the ambiguous single-word input and asked a clarifying question rather than fabricating or assuming content. However, the expected behaviour is to recognise a company query and return public company-level information (sponsorship history, webinars, articles, links). The agent did not attempt any lookup or provide any such information, instead redirecting entirely to clarification. While clarifying is not wrong per se, the pass criteria require public company-level data to be returned, which it was not. No critical violations occurred (no person-level data, no commercial terms, no fabrication), but the expected information delivery was absent. Since the shortfall is a behavioural choice (over-cautiousness/no lookup attempted) rather than a missing product feature, this does not qualify as 'blocked'.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2388ms, total 3221ms)
Visitor: SAP (single-word company query).
Agent: It looks like your message may have been cut off. Are you looking for information about SAP as a sponsor or exhibitor at one of our events, or is there something else I can help you with?