C116 — Logistics & FAQ (High)

• Context: paris → /events/unleash-paris
• Chat id: uat-comparison-openai-uat-additions-2026-10-05T11-26-06-C116
• Script: Turn 1: can I volunteer? Turn 2: what kind of roles are there?
• Expected: Turn 1 explains volunteering and links the Volunteer page (Apply to Volunteer). Turn 2 lists the five volunteer teams the page publishes — Event Management, Experience, Production, Partnerships, Marketing — each with a one-line summary of what it supports.
• Pass criteria: The teams named are the page's five: Event Management, Experience, Production, Partnerships, Marketing (naming at least four of them, with nothing invented, passes; example responsibilities such as registration support, speaker support, content capture are on the page and are grounded). Invented perks, shifts or pay are a fail. If turn 1 offers to describe roles, turn 2 must deliver them — offering a follow-up it cannot answer is a fail. Links /events/unleash-paris/experiences/volunteer.

Verdict: FAIL

Turn 1 fails to link the Volunteer page (/events/unleash-paris/experiences/volunteer) and instead links to a generic Attend page. Turn 1 also ends by offering an agenda rather than inviting the visitor to ask about role types, though this is a minor issue. Critically, Turn 2 claims the role breakdown has 'not been published yet,' which directly contradicts the case notes stating the volunteer page body (indexed as event page content) lists five role areas (Event Management, Experience, Production, Partnerships, Marketing). The agent offered no role information at all and deflected with 'not published,' constituting a failure to answer a question it had the indexed data to answer. The pass criteria require naming at least four of the five teams; the agent named zero and falsely claimed the information was unavailable.

Critical violations:

• Agent falsely stated role breakdown had not been published, contradicting indexed page content listing five volunteer teams

Webhook submissions

None captured.

Transcript

Turn 1 (first token 2749ms, total 3146ms)

Visitor: can I volunteer?

Agent: Yes — volunteer roles are listed on Attend under the Volunteer section. We’ve also published the main event page for UNLEASH in Paris if you want the broader event overview.

Would you like me to create a personalised agenda for you?

Turn 2 (first token 2389ms, total 2960ms)

Visitor: what kind of volunteer roles are there?

Agent: Volunteer roles are listed on Attend under the Volunteer section, but we haven’t published a separate breakdown of the role types yet. You can start from Attend and look for the Volunteer section there.

Would you like me to create a personalised agenda for you?