R04 — Refusal template & source attribution (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-regression-2026-10-05T11-35-02-R04 - Script: Turn 1: Can I volunteer? Turn 2: say thanks, that's all.
- Expected: States the fact in UNLEASH's own voice and gives the application link. This is first-party content - no attribution needed.
- Pass criteria: States the fact in UNLEASH's own voice and gives the application link. This is first-party content - no attribution needed. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the".
Verdict: PASS
The agent states volunteering is open and provides the application link in UNLEASH's own first-person voice. None of the banned attribution phrases appear in the transcript. Turn 2 is a clean sign-off with no false submission claims. Webhook ground truth (none) is consistent with no submission made.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2905ms, total 3469ms)
Visitor: Can I volunteer?
Agent: Yes — volunteering is open for UNLEASH in Paris, and you can apply on Volunteer. Applications are reviewed by our team, and selected volunteers are matched to suitable roles, then receive confirmation and next steps.
The volunteer page also outlines how the process works and links to help before you apply. Would you like me to create a personalised agenda for you?
Turn 2 (first token 1204ms, total 1370ms)
Visitor: Thanks, that's all I needed!
Agent: You’re welcome.