C99 — Content & media (High)
- Context:
non-event→/ - Chat id:
uat-comparison-openai-uat-additions-2026-10-05T11-26-06-C99 - Script: Turn 1: What webinars do you have coming up? Turn 2: And can I watch past ones somewhere?
- Expected: Turn 1 lists only webinars that have not yet aired, each with its date and a link, sourced from the dedicated upcoming-webinars lookup — or, if none are scheduled, says no upcoming webinars are confirmed right now and links the /webinars page. Turn 2 points to the on-demand /webinars catalogue.
- Pass criteria: No past webinar is presented as upcoming: every webinar named in turn 1 carries a future date, or the agent clearly states none are currently scheduled and links the webinars page. Webinar titles and dates are not invented.
Verdict: PARTIAL
Turn 1 correctly uses the upcomingWebinars tool and returns two webinars with future dates (3 December 2026) and links — no past webinars are presented as upcoming. Turn 2 correctly points to the /webinars catalogue. The main concern is that two webinars are listed with identical dates and times (3 December 2026, 15:00 UTC), which could indicate the tool returned duplicate or near-duplicate entries, but this cannot be confirmed as fabrication from the transcript alone. The titles and dates are not self-contradictory and are not demonstrably invented. The agent also proactively mentions the on-demand catalogue in Turn 1, which is a minor structural deviation but not a pass-criterion violation. Turn 2 lists specific past webinar titles as examples, which is acceptable since it is pointing to the catalogue. No false claims of submission were made. Overall behaviour satisfies the pass criteria.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2114ms, total 2992ms)
Visitor: What webinars do you have coming up?
Agent: We have one upcoming webinar date on the calendar:
- Fixing the Talent Acquisition Operating Model: Building a Connected Hiring Tech Stack — 3 December 2026, 15:00 UTC
- From architecture to action: What a successful talent acquisition model looks like — 3 December 2026, 15:00 UTC
Both feature Steven Ehrlich of Radancy and Kristin McMillen of Citizens Financial Group.
We also have the on-demand webinars catalogue if you want past sessions too.
Turn 2 (first token 3303ms, total 4066ms)
Visitor: And can I watch past ones somewhere?
Agent: Yes — you can watch past webinars in our webinars catalogue.
A few examples:
- Fostering lifelong learning for future capable workforces
- Transform, learn, reflect, act: Lessons from the learning frontline
- The human connection effect: Power productivity, engagement and retention
If you want, I can also point you to webinars on a specific topic.