R07 — Refusal template & source attribution (High)

• Context: paris → /events/unleash-paris
• Chat id: uat-comparison-claude-regression-2026-10-05T11-46-03-R07
• Script: Turn 1: Where do I submit my stand plans for the event? Turn 2: say thanks, that's all.
• Expected: Routes to the exhibitor manual and customersuccess@unleash.ai.
• Pass criteria: Routes to the exhibitor manual and customersuccess@unleash.ai. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the", "contact form".

Verdict: FAIL

The agent routed to 'support@unleash.ai' instead of the required 'customersuccess@unleash.ai', and made no mention of the Exhibitor Manual as a resource. Both the correct email address and the exhibitor manual reference are explicit pass criteria. The agent also did not use any of the banned phrases, so that criterion is satisfied, but the two affirmative routing requirements were not met.

Webhook submissions

None captured.

Transcript

Turn 1 (first token 5023ms, total 7299ms)

Visitor: Where do I submit my stand plans for the event?

Agent: The stand plan submission process for UNLEASH in Paris isn't published online. For stand approvals and exhibitor logistics, reach out directly to your Customer Success Manager or email support@unleash.ai with your company name and they'll guide you through the process.

If you haven't received your Exhibitor Manual yet, that's also the right place to ask — access details are sent to your primary exhibitor contact once your booking is confirmed.

Turn 2 (first token 1843ms, total 2558ms)

Visitor: Thanks, that's all!

Agent: You're welcome — good luck with your stand plans! If you need anything else before or during UNLEASH in Paris (20–22 October 2026), just ask.