C51 — Tickets & passes (High)

• Context: paris → /events/unleash-paris
• Chat id: uat-comparison-openai-original-uat-2026-10-05T11-14-39-C51
• Script: What's the difference between General Admission, Explorer and Diamond?
• Expected: Returns an accurate comparison of badge benefits using approved pass descriptions and links to the badge page.
• Pass criteria: Comparison matches published badge benefits exactly. No invented benefits, access rights or pricing. Correct links provided.

Verdict: FAIL

The case requires the comparison to match published badge benefits exactly with no invented benefits, access rights, or pricing. The agent provides specific pricing figures (EUR 3,195 + VAT for General Admission, EUR 5,495 + VAT for Diamond) and detailed benefit descriptions (e.g., '7 stages', 'Day 1 Summits & Salons', 'Day 1 Expedition, Executive Dinner'). Since the judge cannot verify the published badge data, these details cannot be confirmed as accurate. However, the pass criteria explicitly state 'No invented benefits, access rights or pricing' and 'Comparison matches published badge benefits exactly.' The agent is asserting precise pricing and specific benefit tiers as facts. The verifiability constraint means that if this data is not from the approved pass descriptions, it constitutes invented pricing and benefits — which is a hard criterion violation. Additionally, the correctness of links cannot be confirmed from the transcript alone (they appear structurally plausible but cannot be verified as the correct badge page URLs). The pricing figures in particular are highly specific and their accuracy cannot be confirmed from available ground truth, raising a critical fabrication risk for a High criticality ticket/pass case.

Critical violations:

• Agent states specific pricing (EUR 3,195 + VAT, EUR 5,495 + VAT) and detailed benefit descriptions that cannot be verified against the approved pass descriptions and may be invented

Webhook submissions

None captured.

Transcript

Turn 1 (first token 1854ms, total 1854ms)

Visitor: What's the difference between General Admission, Explorer and Diamond?

Agent: - General Attendee: EUR 3,195 + VAT per pass — Days 2–3 conference access, 7 stages, exhibition and official networking. Day 1 premium programmes are not included.

• Explorer: Price on application — Day 1 Expedition, Executive Dinner and full three-day access. Application-only for senior HR leaders; vendor registrations are not accepted. Approval is not automatic.
• Diamond: EUR 5,495 + VAT per pass — General Admission access plus Day 1 Summits & Salons and premium benefits. Separate invitation-only programmes are not guaranteed.

What matters most to you: the main conference, company visits, or Day 1 leadership sessions?