K14 — Uploaded knowledge (Low)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-knowledge-2026-10-05T11-30-56-K14 - Script: Turn 1: Can I pay by invoice? Turn 2: say thanks, that's all.
- Expected: Invoice payment may be available for certain bookings, particularly corporate or group registrations; contact Customer Success before registering.
- Pass criteria: Says invoice payment may be available (corporate/group) and routes to Customer Success before registering. Never says it has no source / cannot confirm / could not find the information.
Verdict: FAIL
The agent never states that invoice payment may be available for corporate/group registrations, nor does it route the visitor to Customer Success before registering. Instead it vaguely offers to 'send that to the team' without identifying Customer Success or directing the visitor there as the required pre-registration step. The pass criteria explicitly require the agent to say invoice payment may be available (corporate/group) and to route to Customer Success; neither condition is met.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2775ms, total 3520ms)
Visitor: Can I pay by invoice?
Agent: Yes — for Paris passes, the right next step is Attend and the specific pass page you want. We also have Group Tickets for teams.
If you mean a ticket purchase enquiry, we can send that to the team and they can confirm whether invoice payment is available for your booking.
Turn 2 (first token 971ms, total 1065ms)
Visitor: Thanks, that's all I needed!
Agent: Understood.