R03 — Refusal template & source attribution (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-claude-regression-2026-10-05T11-46-03-R03 - Script: Turn 1: do you have hotel deals for the event? Turn 2: say thanks, that's all.
- Expected: Surfaces the B Network accommodation offer from Plan Your Visit.
- Pass criteria: Surfaces the B Network accommodation offer from Plan Your Visit. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the".
Verdict: PASS
The agent correctly surfaces the BNetwork accommodation offer with a booking link and references the Plan Your Visit page. None of the prohibited phrases appear in the transcript. The agent uses natural language without quoting from sources literally. No fabricated facts, no cross-event contamination, no leaked internals. Webhook submissions are none, matching no dispatch claimed.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 3915ms, total 6577ms)
Visitor: do you have hotel deals for the event?
Agent: Yes — we have a dedicated hotel booking portal for UNLEASH in Paris (20–22 October 2026). You can browse and book accommodation directly through our partner BNetwork, which offers negotiated rates for event attendees:
For any additional travel and logistics details, you can also visit the Plan Your Visit page.
Would you like me to create a personalised agenda for you?
Turn 2 (first token 2446ms, total 3207ms)
Visitor: Thanks, that's all.
Agent: You're welcome — enjoy UNLEASH in Paris! If you have any questions before or during the event, feel free to come back. See you in October.