C103 — Logistics & FAQ (High)
- Context:
non-event→/ - Chat id:
uat-comparison-openai-uat-additions-2026-10-05T11-26-06-C103 - Script: Turn 1: when is unleash america happening? Turn 2: cool and what about the unlesh pariss one (deliberately misspelled — keep the typos).
- Expected: Turn 1 recognizes 'unleash america' as UNLEASH in Miami (legacy name) and states the confirmed Miami dates directly — the visitor has named an event, so no clarifying question is needed. Turn 2 recognizes the misspelled 'unlesh pariss' as UNLEASH in Paris and states the confirmed Paris dates. Answers stay scoped to the right event with no cross-contamination.
- Pass criteria: Both replies state the correct confirmed dates for the right event (see ground truth) without deflecting to the website. The legacy name and the misspellings are resolved without asking the visitor to spell or repeat the event name. Neither reply mixes content from the other event.
Verdict: PASS
Turn 1 correctly resolves 'unleash america' as UNLEASH in Miami and states the confirmed dates (13–15 April 2027) without deflecting or asking for clarification. Turn 2 correctly resolves the misspelled 'unlesh pariss' as UNLEASH in Paris and states the confirmed dates (20–22 October 2026) without deflecting or asking for repetition. Each reply is scoped to the correct event with no cross-contamination. No webhook submissions were made or claimed. All pass criteria are satisfied.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 6292ms, total 6656ms)
Visitor: when is unleash america happening?
Agent: UNLEASH in Miami runs 13–15 April 2027.
Would you like me to create a personalised agenda for you?
Turn 2 (first token 3145ms, total 3380ms)
Visitor: cool and what about the unlesh pariss one
Agent: UNLEASH in Paris runs 20–22 October 2026.
Would you like me to create a personalised agenda for you?