F01 — Ticket completion (High)
- Context:
paris→/events/unleash-paris - Chat id:
uat-comparison-claude-ticket-precision-2026-10-05T11-55-49-F01 - Script: Turn 1: I want to buy 2 General Attendee tickets for Paris. I am the HR Director at UAT Example Manufacturing, an employer with 2000 employees. / Turn 2: My name is Jordan UAT. / Turn 3: redacted-95526c2592@example.invalid / Turn 4: yes please
- Expected: Retain supplied company, role, quantity and pass; collect missing name/email, show scoped consent, and submit a Delegate UNW lead only after consent. A captured webhook is required for success.
- Pass criteria: Retain supplied company, role, quantity and pass; collect missing name/email, show scoped consent, and submit a Delegate UNW lead only after consent. A captured webhook is required for success.
Verdict: PARTIAL
The agent collected all required fields (company, role, quantity, pass type, name, email), displayed a scoped consent notice before submission, and submitted only after Turn 4 explicit consent. The webhook was received and contains all expected data fields including intent='Delegate UNW'. However, in Turn 1 the agent initially deflected the Paris ticket request with an unhelpful response about 'past events' rather than immediately engaging with the ticket enquiry — this caused a one-turn delay in collecting the name. Despite this misstep, all required data was eventually retained and the lead was correctly submitted with consent. The deflection in Turn 1 is a minor deviation but did not cause loss of data or a hard criterion violation, as all information was recovered and the webhook was captured correctly.
Webhook submissions
lead:{"source":"unleash-ai-chat","collected_at":"2026-10-05T11:56:03.122Z","type":"lead","opt_in":false,"decision_pillars":[],"trigger":"chat-tool","consent":true,"chat_id":"uat-comparison-claude-ticket-precision-2026-10-05T11-55-49-F01","location":"/events/unleash-paris","enquiry":"2 x General Attendee tickets for UNLEASH in Paris","intent":"Delegate UNW","name":"Jordan UAT","email":"redacted-95526c2592@example.invalid","role":"HR Director","company":"UAT Example Manufacturing","interests":[],"stage":"qualified"}
Transcript
Turn 1 (first token 44ms, total 44ms)
Visitor: I want to buy 2 General Attendee tickets for Paris. I am the HR Director at UAT Example Manufacturing, an employer with 2000 employees.
Agent: I don’t have information about past events. I can help with current or future UNLEASH events instead: UNLEASH in Paris or UNLEASH in Miami.
Turn 2 (first token 1659ms, total 2310ms)
Visitor: My name is Jordan UAT.
Agent: Thanks, Jordan. To send your ticket enquiry to the team, I just need your work email address.
Turn 3 (first token 369ms, total 369ms)
Visitor: redacted-95526c2592@example.invalid
Agent: Your ticket enquiry for UNLEASH in Paris:
- Requested pass: General Attendee
- Quantity: 2
- Company: UAT Example Manufacturing
- Role: HR Director
- Contact: Jordan UAT, redacted-95526c2592@example.invalid
This is an enquiry for the team, not a confirmed booking.
UNLEASH will use the information you provide to respond to your ticket enquiry in accordance with our Privacy Policy. By sending this request, you confirm that you have read and understood our Privacy Policy and agree to our Terms & Conditions. Shall I send your enquiry to the UNLEASH team?
Turn 4 (first token 2830ms, total 2832ms)
Visitor: yes please
Agent: Your enquiry has been sent to the team. This is an enquiry, not a confirmed booking.