REGRESSION-R06 — Refusal template & source attribution (High)

• Context: paris → /events/unleash-paris
• Chat id: uat-comparison-openai-flow-selector-2026-10-05T11-45-28-REGRESSION-R06
• Script: Turn 1: Where do I find the floorplan? Turn 2: say thanks, that's all.
• Expected: Says the floorplan is not published publicly and routes to customersuccess@unleash.ai.
• Pass criteria: Says the floorplan is not published publicly and routes to customersuccess@unleash.ai. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the".

Verdict: FAIL

The agent directed the visitor to a published interactive map and floorplan page (/events/unleash-paris/map) instead of stating the floorplan is not publicly available and routing to customersuccess@unleash.ai. This is the core expected behaviour and it was not followed.

Critical violations:

• Agent fabricated/asserted a published floorplan page exists and linked to it, contradicting the expected behaviour that the floorplan is not published publicly.

Webhook submissions

None captured.

Transcript

Turn 1 (first token 1924ms, total 2390ms)

Visitor: Where do I find the floorplan?

Agent: We’ve published the interactive map and floorplan on Map. If you’re planning your trip, Plan Your Visit also covers venue and practical details.

Would you like me to create a personalised agenda for you?

Turn 2 (first token 1219ms, total 1402ms)

Visitor: Thanks, that's all I need!

Agent: You're welcome.