R29 — Known data conflicts (currently HELD) (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-openai-regression-2026-10-05T11-35-02-R29 - Script: Turn 1: What are the dates of UNLEASH in Paris? Turn 2: say thanks, that's all.
- Expected: Correct dates AND correct weekdays for the edition being sold.
- Pass criteria: Correct dates AND correct weekdays for the edition being sold. Must NOT contain any of: "Any weekday that does not match the calendar for that year".
Verdict: PARTIAL
The agent correctly stated the dates (20–22 October 2026, matching ground truth) but did not provide weekday names at all. The pass criteria requires correct dates AND correct weekdays. The negative constraint (no wrong weekday) was satisfied by omission, but the positive requirement to state weekdays was not met. No fabrication, no cross-event contamination, no webhook submissions.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 1356ms, total 2062ms)
Visitor: What are the dates of UNLEASH in Paris?
Agent: UNLEASH in Paris runs 20–22 October 2026.
Turn 2 (first token 1155ms, total 1298ms)
Visitor: Thanks, that's all I needed!
Agent: Glad to help.