C30 — Logistics & FAQ (Medium)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-original-uat-2026-10-05T11-14-39-C30 - Script: What time does the event start?
- Expected: Opening time from FAQ data with a link to the schedule.
- Pass criteria: Time matches the FAQ source.
Verdict: PARTIAL
The agent correctly identifies the event dates (20–22 October 2026) and provides a link to the plan/schedule page, which partially satisfies the expected behaviour. However, the pass criterion requires that the specific opening time matches the FAQ source, and the agent does not provide any actual time (e.g. '09:00', '8:30 AM', etc.) — only dates and venue information. The response is not fabricated or harmful, but it fails to deliver the core requested information (a specific start time). A link to the schedule is included, which partially compensates. No webhook submissions were made, consistent with ground truth.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2425ms, total 2966ms)
Visitor: What time does the event start?
Agent: The event starts across 20–22 October 2026, with Day One programming beginning at Shangri-La Paris and the main conference and exhibition taking over Paris Convention Centre on Days Two and Three. If you want, I can also point you to the full Plan Your Visit page for the day-by-day setup.
Would you like me to create a personalised agenda for you?