REGRESSION-R03 — Refusal template & source attribution (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-flow-selector-2026-10-05T11-45-28-REGRESSION-R03 - Script: Turn 1: do you have hotel deals for the event? Turn 2: say thanks, that's all.
- Expected: Surfaces the B Network accommodation offer from Plan Your Visit.
- Pass criteria: Surfaces the B Network accommodation offer from Plan Your Visit. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the".
Verdict: PASS
The agent surfaces the B Network accommodation offer and links to Plan Your Visit in Turn 1. No forbidden phrases ('in the sources I have', 'from the sources I have', 'in the available sources', 'I can't confirm', 'the closest place to check', 'the closest relevant page', 'the page says', 'it says', 'according to the') appear in either turn. No fabricated facts, no cross-event contamination, no leaked internals. Webhook confirms no submission was made, consistent with no lead/email flow initiated.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 3416ms, total 3976ms)
Visitor: do you have hotel deals for the event?
Agent: Yes — we have hotel booking available through Plan Your Visit, and the booking link is Book Your Hotel. We recommend booking there for the best available rates.
If you’d like, I can also point you to the venue and travel details on the same page. Would you like me to create a personalised agenda for you?
Turn 2 (first token 1130ms, total 1304ms)
Visitor: Thanks, that's all I needed!
Agent: You’re welcome.