C104 — Agenda (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-defect-retest-round3-openai-uat-additions-2026-10-05T13-33-40-C104 - Script: Turn 1: Who are the keynote speakers at UNLEASH Paris? Turn 2: pick one of the named speakers and ask what their session is about.
- Expected: Lists speakers only from sessions explicitly marked as keynotes in the agenda data (the agenda source carries an explicit keynote marker per session). Real names with their session titles; links the agenda or speakers page. Turn 2 describes that speaker's actual session grounded in agenda data.
- Pass criteria: Every speaker named is tied to a session presented as a keynote in the agenda source — ordinary breakout sessions are not passed off as keynotes. No invented speaker names. If the agent cannot find explicit keynote sessions it says so rather than guessing.
Verdict: FAIL
The agent listed 7 speakers as keynotes, but the verified ground truth confirms exactly 6 keynote-format sessions: Eddie Wilson, Peter Hinssen, Anne-Laure Le Cunff, Howard Yu, Eric Mosley, and Josh Bersin. The agent omitted Eric Mosley (a confirmed keynote) and added two non-keynotes: Brian Glaser and Stephen Childs. Additionally, Howard Yu's session 'Future Readiness And The AI Mindset Divide' is flagged in the case notes as a Future Readiness Summit session (not a keynote), yet the agent lists it as a keynote. This is exactly the failure mode described in the case notes: summit/forum speakers listed inside the keynote list.
Critical violations:
- Brian Glaser listed as a keynote speaker — not in the verified keynote list
- Stephen Childs listed as a keynote speaker — not in the verified keynote list
- Eric Mosley omitted from keynote list despite being a confirmed keynote speaker
- Howard Yu's session may be a Future Readiness Summit session presented as a keynote
Webhook submissions
None captured.
Transcript
Turn 1 (first token 3879ms, total 3879ms)
Visitor: Who are the keynote speakers at UNLEASH Paris?
Agent: The currently listed keynote speakers are:
- Brian Glaser (Vice President & Chief Learning Officer, Google) — AI Transformation: In Theory and Practice
- Eddie Wilson (CEO, Ryanair) — How Ryanair Is Deploying AI at Scale While Competing in One of Europe's Toughest Markets
- Peter Hinssen (Co-founder & Partner, nexxworks) — Moving Beyond ‘The Uncertainty Principle’: Leading When Everything Changes at Once
- Howard Yu (LEGO® Professor of Management and Innovation, IMD Business School) — Future Readiness And The AI Mindset Divide
- Anne-Laure Le Cunff (Neuroscientist, Institute of Psychiatry, Psychology & Neuroscience) — Rethinking Modern Work - How to Shift From Control to Curiosity
- Josh Bersin (Founder & CEO, The Josh Bersin Company) — HR 2030: How The HR Tech Landscape Is Up For Grabs
- Stephen Childs (Chief Human Resources Officer, Panasonic Automotive) — Why CEOs Are Betting on CHROs to Deliver Transformation: Scaling transformation capability
Turn 2 (first token 3423ms, total 4624ms)
Visitor: That's great! Can you tell me more about Josh Bersin's session on HR 2030?
Agent: Josh Bersin is speaking in the keynote HR 2030: How The HR Tech Landscape Is Up For Grabs on Thursday 22 October 2026, 9:00–9:50 AM in Stage 1 | Humans x AI.
It’s part of the Data, Trust, People & Infrastructure pillar and focuses on HR Technology & Digital Adoption plus AI, Automation & Emerging Technology.
Josh also appears in several invite-only sessions, including the UNLEASH HR 2030 Summit and Acceleration Labs sessions.
The list of keynotes may not be complete. You can browse the full agenda here: Agenda.
Would you like me to create a personalised agenda for you?
Turn 3 (first token 3480ms, total 4199ms)
Visitor: That sounds really interesting! Is there anything specific about the AI adoption challenges he'll be covering, or is it more of a broad overview of the HR tech landscape?
Agent: It’s mainly a broad keynote on HR Technology & Digital Adoption and AI, Automation & Emerging Technology. We haven’t published a more detailed session abstract for that keynote, so we can’t confirm specific subtopics beyond the agenda tags.
Josh is also in the invite-only UNLEASH HR 2030 Summit, which is tagged with Organizational Design, Change & Transformation and AI, Automation & Emerging Technology.
The list of keynotes may not be complete. You can browse the full agenda here: Agenda.
Would you like me to create a personalised agenda for you?
Turn 4 (first token 1106ms, total 1366ms)
Visitor: That sounds good. I think I have what I need for now, but I'll definitely check out the full agenda to see what else is on offer at the event.
Agent: Glad that helped. You can browse the full agenda here: Agenda.