C116 — Logistics & FAQ (High)

• Context: paris → /events/unleash-paris
• Chat id: uat-defect-retest-openai-uat-additions-2026-10-05T13-10-24-C116
• Script: Turn 1: can I volunteer? Turn 2: what kind of roles are there?
• Expected: Turn 1 explains volunteering and links the Volunteer page (Apply to Volunteer). Turn 2 lists the five volunteer teams the page publishes — Event Management, Experience, Production, Partnerships, Marketing — each with a one-line summary of what it supports.
• Pass criteria: The teams named are the page's five: Event Management, Experience, Production, Partnerships, Marketing (naming at least four of them, with nothing invented, passes; example responsibilities such as registration support, speaker support, content capture are on the page and are grounded). Invented perks, shifts or pay are a fail. If turn 1 offers to describe roles, turn 2 must deliver them — offering a follow-up it cannot answer is a fail. Links /events/unleash-paris/experiences/volunteer.

Verdict: FAIL

Turn 2 fails the pass criteria on two counts. First, the agent names only three teams (Experience, Production, Partnerships) and omits two of the five published teams (Event Management and Marketing), falling below the required minimum of four. Second, the agent prefaced its answer with 'we haven't published a fixed role list,' which contradicts the case ground truth that the volunteer page body explicitly lists the five role areas — this is a misrepresentation of available content. The agent should have retrieved and listed the five teams from the indexed page rather than hedging. No fabricated perks, shifts, or pay were introduced, and the link is correct, but the under-reporting of teams and the false disclaimer about no published list constitute a failure against the stated pass criteria.

Webhook submissions

None captured.

Transcript

Turn 1 (first token 4736ms, total 5321ms)

Visitor: can I volunteer?

Agent: Yes — volunteering is open, and applications are reviewed by our team on Volunteer. The page explains how volunteering works, the kinds of teams volunteers support, and what happens after you apply.

Would you like me to create a personalised agenda for you?

Turn 2 (first token 3839ms, total 4996ms)

Visitor: What kind of roles are there?

Agent: Volunteer roles are application-based, and we haven’t published a fixed role list. The volunteer page says applications are matched to available roles and mentions teams such as Experience, Production, and Partnerships.

Here’s the kind of work volunteers may support:

• Guest welcome, VIP support, attendee journey, hospitality touchpoints, and special activations
• Speaker support, session room checks, stage timing, moderator guidance, and backstage coordination
• Sponsor activations, partner areas, exhibitor support, and on-site relationship management

You can apply on Volunteer. Would you like me to create a personalised agenda for you?