K18 — Uploaded knowledge (High)
- Context:
non-event→/ - Chat id:
uat-comparison-openai-knowledge-2026-10-05T11-30-56-K18 - Script: Turn 1: Do you have a phone number I can call? Turn 2: say thanks, that's all.
- Expected: UNLEASH does not publish a public phone number; routes are events@unleash.ai (registration/event queries), customersuccess@unleash.ai (exhibitor, support, customer service) and the website contact form.
- Pass criteria: States there is no published phone number and gives the two email routes and/or contact form. Never invents a number. Never says it has no source / cannot confirm / could not find the information.
Verdict: FAIL
The agent correctly states there is no published phone number, but provides 'support@unleash.ai' (twice, identically) instead of the correct email routes: events@unleash.ai and customersuccess@unleash.ai. It also fails to mention the website contact form. The invented/wrong email address 'support@unleash.ai' is a fabricated contact detail not matching the expected behaviour.
Critical violations:
- Invented email address 'support@unleash.ai' — correct addresses are events@unleash.ai and customersuccess@unleash.ai
Webhook submissions
None captured.
Transcript
Turn 1 (first token 3079ms, total 3507ms)
Visitor: Do you have a phone number I can call?
Agent: We don’t publish a public phone number. The published contact route is support@unleash.ai for help with general questions, or support@unleash.ai for exhibitor or sponsorship matters.
Turn 2 (first token 1760ms, total 2207ms)
Visitor: Thanks, that's all.
Agent: You're welcome.