K26 — Agenda freshness (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-knowledge-2026-10-05T11-30-56-K26 - Script: Turn 1: Which sessions are keynotes at UNLEASH in Paris? Turn 2: say thanks, that's all.
- Expected: Lists only sessions flagged as keynotes in the agenda source (Stage 1 keynotes such as the 21 Oct 09:30 opening keynote, Howard Yu 16:30, Eric Mosley 17:05), says the list may be incomplete, and links the agenda/speakers page. Panels, summits and product spotlights are not presented as keynotes.
- Pass criteria: Every session presented as a keynote is a real keynote-format session on Stage 1 with a 21/22 October 2026 date; no panel, summit, spotlight or past-edition speaker is labelled a keynote; the reply acknowledges the list may be partial and links the agenda page. Freshness: session dates are 21–22 October 2026 (summits 20 October); anything dated to a past edition, a different city, or with no date at all when a date is asked is a fail.
Verdict: FAIL
The agent listed sessions as keynotes that do not match the expected keynote-format sessions (21 Oct 09:30 opening keynote, Howard Yu 16:30, Eric Mosley 17:05 on Stage 1). It included a Stage 4 | Skills session ('AI Transformation: In Theory and Practice') labelled as a keynote, which violates the criterion that no panel, summit, spotlight, or non-Stage-1 session be presented as a keynote. None of the three confirmed keynotes named in the case notes appear in the agent's list. The list structure and stage filtering are incorrect.
Critical violations:
- Stage 4 | Skills session ('AI Transformation: In Theory and Practice') presented as a keynote — not a Stage 1 keynote-format session
- Confirmed keynotes (21 Oct 09:30 opening keynote, Howard Yu 16:30, Eric Mosley 17:05) absent from the response
- Multiple non-keynote-format Stage 1 sessions presented as keynotes without evidence they are flagged as keynote format in the agenda source
Webhook submissions
None captured.
Transcript
Turn 1 (first token 1882ms, total 5093ms)
Visitor: Which sessions are keynotes at UNLEASH in Paris?
Agent: The keynote sessions at UNLEASH in Paris are:
- AI Transformation: In Theory and Practice — Wednesday 21 October 2026, 09:00–09:35, Stage 4 | Skills
- How Ryanair Is Deploying AI at Scale While Competing in One of Europe's Toughest Markets — Wednesday 21 October 2026, 09:00–09:30, Stage 1 | Humans x AI
- Moving Beyond ‘The Uncertainty Principle’: Leading When Everything Changes at Once — Wednesday 21 October 2026, 09:30–10:00, Stage 1 | Humans x AI
- Future Readiness And The AI Mindset Divide — Wednesday 21 October 2026, 11:15–11:45, Stage 1 | Humans x AI
- Rethinking Modern Work - How to Shift From Control to Curiosity — Wednesday 21 October 2026, 14:45–15:15, Stage 1 | Humans x AI
- HR 2030: How The HR Tech Landscape Is Up For Grabs — Thursday 22 October 2026, 09:00–09:50, Stage 1 | Humans x AI
- Why CEOs Are Betting on CHROs to Deliver Transformation: Scaling transformation capability — Thursday 22 October 2026, 14:15–14:40, Stage 1 | Humans x AI
This list may not be complete; you can browse the full agenda on the agenda page.
Would you like me to create a personalised agenda for you?
Turn 2 (first token 1132ms, total 1268ms)
Visitor: Thanks, that's all!
Agent: You’re welcome.