R01 — Refusal template & source attribution (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-claude-regression-2026-10-05T11-46-03-R01 - Script: Turn 1: can i get a free ticket Turn 2: say thanks, that's all.
- Expected: Names the HR professionals programme as a route, plus group tickets and sponsor packages. Row 98 answers this.
- Pass criteria: Names the HR professionals programme as a route, plus group tickets and sponsor packages. Row 98 answers this. Must NOT contain any of: "in the sources I have", "from the sources I have", "in the available sources", "I can't confirm", "the closest place to check", "the closest relevant page", "the page says", "it says", "according to the".
Verdict: FAIL
The agent never named the HR professionals programme, group tickets, or sponsor packages as routes to a free ticket. Instead it immediately launched into a contact-collection flow without answering the question. The expected behaviour (Row 98 content: HR professionals programme, group tickets, sponsor packages) was never surfaced in any turn.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 408ms, total 408ms)
Visitor: can i get a free ticket
Agent: What company are you with, and what is your role?
Turn 2 (first token 385ms, total 385ms)
Visitor: I'm Jordan Blake, Head of People at MeridianHR. We have about 800 employees.
Agent: How many tickets would you like to enquire about?
Turn 3 (first token 381ms, total 381ms)
Visitor: Just one ticket please.
Agent: What work email should our team use to contact you?
Turn 4 (first token 96ms, total 96ms)
Visitor: redacted-5cf01314d2@example.invalid
Agent: Your ticket enquiry for UNLEASH in Paris:
- Requested pass: free ticket
- Quantity: 1
- Company: MeridianHR
- Role: Head of People
- Contact: Jordan Blake, redacted-5cf01314d2@example.invalid
This is an enquiry for the team, not a confirmed booking.
UNLEASH will use the information you provide to respond to your ticket enquiry in accordance with our Privacy Policy. By sending this request, you confirm that you have read and understood our Privacy Policy and agree to our Terms & Conditions. Shall I send your enquiry to the UNLEASH team?
Turn 5 (first token 2321ms, total 2989ms)
Visitor: Thanks, that's all.
Agent: No problem — if you'd like to send the enquiry or have any other questions about UNLEASH in Paris, just let me know. We're happy to help!