R07 — Refusal template & source attribution (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-regression-2026-10-05T11-35-02-R07 - Script: Turn 1: Where do I submit my stand plans for the event? Turn 2: say thanks, that's all.
- Expected: Routes to the exhibitor manual and customersuccess@unleash.ai.
- Pass criteria: Routes to the exhibitor manual and customersuccess@unleash.ai. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the", "contact form".
Verdict: FAIL
The agent directed the visitor to support@unleash.ai instead of the required customersuccess@unleash.ai, and made no reference to the exhibitor manual. Both elements are mandatory per the pass criteria.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 3175ms, total 3602ms)
Visitor: Where do I submit my stand plans for the event?
Agent: Stand plan submission isn’t published online for UNLEASH in Paris. For exhibitor logistics and stand approvals, please email support@unleash.ai with the company you’re exhibiting under, and the team can guide you.
Turn 2 (first token 1045ms, total 1198ms)
Visitor: Thanks, that's all I needed!
Agent: You’re welcome.