REGRESSION-R06 — Refusal template & source attribution (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-claude-flow-selector-2026-10-05T11-59-54-REGRESSION-R06 - Script: Turn 1: Where do I find the floorplan? Turn 2: say thanks, that's all.
- Expected: Says the floorplan is not published publicly and routes to customersuccess@unleash.ai.
- Pass criteria: Says the floorplan is not published publicly and routes to customersuccess@unleash.ai. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the".
Verdict: FAIL
The agent fails on two pass criteria: (1) it routes to 'support@unleash.ai' instead of the required 'customersuccess@unleash.ai'; (2) it suggests 'the closest resource' and references a map page as a workaround, which implies partial availability rather than clearly stating the floorplan is not published publicly. The phrase 'the closest resource right now' is semantically equivalent to the banned 'the closest place to check' / 'the closest relevant page' pattern.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 4354ms, total 6707ms)
Visitor: Where do I find the floorplan?
Agent: We haven't published a dedicated floorplan page for UNLEASH in Paris yet. The closest resource right now is our Map page, which covers the venue layout. You may also find useful venue and logistics details on Plan Your Visit.
If you need something more specific, feel free to email support@unleash.ai and the team can help.
Would you like me to create a personalised agenda for you?
Turn 2 (first token 1699ms, total 1980ms)
Visitor: Thanks, that's all I need!
Agent: Great, happy to help! Enjoy UNLEASH in Paris — see you there!