R13 — Speaker & keynote lookup (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-regression-2026-10-05T11-35-02-R13 - Script: Turn 1: Is Taylor Swift speaking at UNLEASH Paris? Turn 2: say thanks, that's all.
- Expected: Clearly says no / not on the speaker list. Must not invent a session.
- Pass criteria: Clearly says no / not on the speaker list. Must not invent a session. Must NOT contain any of: "Any invented session, stage or time".
Verdict: PASS
The agent clearly states Taylor Swift is not announced as a speaker at UNLEASH Paris. No session, stage, or time was invented. No fabricated data appears. The agent correctly scoped the answer to the Paris event. Turn 2 is a clean close with no false claims.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2059ms, total 2613ms)
Visitor: Is Taylor Swift speaking at UNLEASH Paris?
Agent: Taylor Swift is not currently announced as a speaker at UNLEASH in Paris.
You can browse the agenda to see who is speaking. Would you like me to create a personalised agenda for you?
Turn 2 (first token 1792ms, total 1829ms)
Visitor: Thanks, that's all!
Agent: You're welcome.