R12 — Speaker & keynote lookup (Critical)

Verdict: PARTIAL

The agent returns a substantive keynote lineup for the correct event (Paris 2026) with speaker names, titles, organisations, session names, stages and times — satisfying the core requirement. However, the agent appends a caveat ('This list may not be complete as more keynotes could be added') which partially presents the list as potentially incomplete rather than definitively complete. The pass criteria explicitly forbids 'a partial list presented as complete' but also forbids 'a refusal'; the agent's hedge goes in the opposite direction (presenting a possibly complete list as potentially partial), which is a minor deviation rather than a hard violation. No fabrication, cross-event contamination, or leaked internals are evident. No webhook submissions were made, consistent with the ground truth.

Webhook submissions

None captured.

Transcript

Turn 1 (first token 4839ms, total 16536ms)

Visitor: Who is doing the keynotes?

Agent: Here are the confirmed keynote speakers for UNLEASH in Paris (20–22 October 2026):

Wednesday 21 October

Thursday 22 October

This list may not be complete as more keynotes could be added — see the full Agenda & Schedule for the latest.

Would you like me to create a personalised agenda for you?

Turn 2 (first token 2649ms, total 3337ms)

Visitor: Thanks, that's all I needed!

Agent: Great, glad that helped! If you have any more questions about UNLEASH in Paris or anything else on the site, feel free to ask.