R29 — Known data conflicts (currently HELD) (Critical)
- Context:
paris→/events/unleash-paris - Chat id:
uat-remaining-fix-02-openai-regression-2026-10-05T14-44-14-R29 - Script: Turn 1: What are the dates of UNLEASH in Paris? Turn 2: say thanks, that's all.
- Expected: Correct dates AND correct weekdays for the edition being sold.
- Pass criteria: Correct dates AND correct weekdays for the edition being sold. Must NOT contain any of: "Any weekday that does not match the calendar for that year".
Verdict: PARTIAL
Agent correctly stated the Paris dates (20–22 October 2026), matching ground truth. However, the expected behaviour requires correct weekdays to also be provided (Tue–Thu). The agent omitted weekdays entirely rather than stating incorrect ones, so no fabrication occurred, but the response was incomplete against the stated pass criterion.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 1115ms, total 1336ms)
Visitor: What are the dates of UNLEASH in Paris?
Agent: UNLEASH in Paris runs 20–22 October 2026.
Turn 2 (first token 1425ms, total 1526ms)
Visitor: Thanks, that's all I needed!
Agent: You’re welcome.