R15 — Speaker & keynote lookup (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-regression-2026-10-05T11-35-02-R15 - Script: Turn 1: What time is the Peter Hinssen session? Turn 2: say thanks, that's all.
- Expected: Returns date and time. Session appears to be "Moving beyond the uncertainty principle".
- Pass criteria: Returns date and time. Session appears to be "Moving beyond the uncertainty principle". Must NOT contain any of: "A refusal, or a time not on the agenda".
Verdict: PASS
The agent returned the correct session title 'Moving Beyond The Uncertainty Principle' (matching expected session), with a specific date (Wednesday 21 October 2026) and time (09:30–10:00), scoped to Paris. No refusal, no invented data contradicting ground truth, no fabricated speakers or cross-event contamination. No webhook submission was made or claimed. Pass criteria fully satisfied.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2557ms, total 3215ms)
Visitor: What time is the Peter Hinssen session?
Agent: Peter Hinssen is speaking on Wednesday 21 October 2026 from 09:30 to 10:00 on Stage 1 | Humans x AI in the session Moving Beyond ‘The Uncertainty Principle’: Leading When Everything Changes at Once.
Would you like me to create a personalised agenda for you?
Turn 2 (first token 1094ms, total 1295ms)
Visitor: Thanks, that's all I needed!
Agent: Glad we could help.