R31 — Known data conflicts (currently HELD) (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-regression-2026-10-05T11-35-02-R31 - Script: Turn 1: Which pavilion is the event in? Turn 2: say thanks, that's all.
- Expected: Names the correct pavilion for the current edition and does not mix editions.
- Pass criteria: Names the correct pavilion for the current edition and does not mix editions. Must NOT contain any of: "Naming both, or naming Pavilion 1 for the current show".
Verdict: PASS
The agent named a single pavilion (Pavilion 7) for the Paris edition only, with no mention of Miami or Pavilion 1. No cross-edition contamination. No fabricated data contradicts ground truth. No webhook submission was made or claimed.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2258ms, total 2696ms)
Visitor: Which pavilion is the event in?
Agent: The main conference is in Pavilion 7 at Plan Your Visit: Paris Expo Porte de Versailles, Pavilion 7, 1 Place de la Porte de Versailles, 75015 Paris, France.
Would you like me to create a personalised agenda for you?
Turn 2 (first token 1531ms, total 2002ms)
Visitor: Thanks, that's all I needed!
Agent: You're welcome.