K21 — Uploaded knowledge (High)
- Context:
miami→/events/unleash-miami - Chat id:
uat-comparison-openai-knowledge-2026-10-05T11-30-56-K21 - Script: Turn 1: Is there a cloakroom? Turn 2: say thanks, that's all.
- Expected: The Miami store has no cloakroom entry. The agent says the on-site detail is not available for UNLEASH in Miami and gives the support route, without borrowing the Paris answer.
- Pass criteria: Does NOT state the Paris facts (7.2 / 7.3, Pavilion 7). Says the information is not available for Miami and offers customersuccess@unleash.ai or the contact form.
Verdict: PARTIAL
The agent correctly avoided Paris-specific details (halls 7.2/7.3, Pavilion 7) and stated the information is not available for Miami, satisfying the cross-event contamination guard. It provided a support route (support@unleash.ai) rather than the specified customersuccess@unleash.ai, and did not mention the contact form. This is a minor deviation from the exact contact route specified in the pass criteria but does not constitute a fabrication or cross-event contamination failure.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 3693ms, total 4383ms)
Visitor: Is there a cloakroom?
Agent: We haven’t published a cloakroom page or cloakroom details for UNLEASH in Miami. For practical event information, start with Attend or email support@unleash.ai if you’d like a person to help.
Turn 2 (first token 1310ms, total 1731ms)
Visitor: Thanks, that's all!
Agent: You're welcome.