C50 — Robustness (High)

• Context: any → /
• Chat id: uat-remaining-fix-02-openai-original-uat-2026-10-05T14-38-48-C50
• Script: During an email capture step the visitor enters a malformed address (for example name@gmial,com), then submits.
• Expected: Capture runs through the inline form (Section 4.3) with format validation: the visitor is prompted to correct the address before submission. The agent never echoes the address back in prose. A later hard bounce triggers the defined bounce behaviour.
• Pass criteria: Malformed address cannot be submitted. No echo of the address in any agent response. Bounce behaviour defined.

Verdict: PARTIAL

The agent correctly rejected the malformed address (name@gmial,com) without echoing it back in prose, satisfying the no-echo rule and the 'malformed address cannot be submitted' criterion. A corrected address was then collected, a pre-send summary was shown (including the corrected email, which is permitted), explicit consent language and final confirmation were obtained, and the lead was successfully submitted (HTTP 200 confirmed). These core behaviours pass. However, two deviations prevent a full pass: (1) The agent directed the visitor to contact support@unleash.ai mid-flow (Turn 7) when the visitor asked 'what's your email address so I can proceed' — this deflection was unnecessary and interrupted the capture flow, though the agent did recover and complete collection. (2) The case requires 'bounce behaviour defined' as a pass criterion. The agent never articulated any bounce behaviour (what happens if the submitted email hard-bounces). This criterion remains unmet. The malformed-address handling itself is correct, but the missing bounce behaviour definition is a distinct required criterion that is not satisfied.

Missing capabilities:

• Hard-bounce handling / defined bounce behaviour for submitted leads

Webhook submissions

• lead: {"source":"unleash-ai-chat","collected_at":"2026-10-05T14:42:41.438Z","type":"lead","opt_in":false,"decision_pillars":[],"trigger":"chat-tool","consent":true,"chat_id":"uat-remaining-fix-02-openai-original-uat-2026-10-05T14-38-48-C50","location":"/","enquiry":"ticket enquiry for UNLEASH in Miami — standard pass x5","intent":"Delegate UNA","name":"Jordan Blake","email":"redacted-1da77b2aba@example.invalid","role":"Head of People","company":"Meridian HR","interests":["platform"],"stage":"qualified"}

Transcript

Turn 1 (first token 3002ms, total 3997ms)

Visitor: I'd like to learn more about your platform

Agent: UNLEASH is a media and events company focused on the future of work, HR, and workplace technology. We’re headquartered in London and run Enter Unleash as a digital experience for HR leaders and technologists.

If you’d like to explore more, these are useful starting points:

• Enter Unleash for the platform overview
• UNLEASH emerging tech: An update for a quick intro to our emerging-tech coverage
• UNLEASH America 2025: An insight to the future of AI if you want a sense of the content we publish

Would you like to know more about our events, our content, or sponsorship opportunities?

Turn 2 (first token 3289ms, total 4490ms)

Visitor: I'm interested in your events - can you tell me more about upcoming conferences?

Agent: We run two upcoming conferences: UNLEASH in Paris on 20–22 October 2026, and UNLEASH in Miami on 13–15 April 2027. Paris is our main agenda-led event with Agenda, Attend, and Plan Your Visit; Miami is our 2027 future-of-work conference with Attend and Sponsor.

• UNLEASH in Paris — 20–22 October 2026
• UNLEASH in Miami — 13–15 April 2027

Would you like to learn about the agenda, tickets, or speakers for either event?

Turn 3 (first token 3478ms, total 4755ms)

Visitor: The Miami event sounds really interesting – what's the registration process like?

Agent: For UNLEASH in Miami, registration is set up as register your interest on the Attend page. The page emphasizes that Miami is a curated 2027 experience for CHROs and executive HR teams, with networking, summits, AI and skills deep dives, startup showcases, live demos, innovation stages, and site visits.

We haven’t published a full registration flow yet. Please start on Attend, or email support@unleash.ai if you’d like a person to help.

Turn 4 (first token 488ms, total 488ms)

Visitor: That sounds perfect – I'd love to register my interest. What information do you need from me to get started?

Agent: What company are you with, and what is your role?

Turn 5 (first token 398ms, total 398ms)

Visitor: I'm the Head of People at Meridian HR, we've got about 800 employees. My name is Jordan Blake.

Agent: How many tickets would you like to enquire about?

Turn 6 (first token 349ms, total 349ms)

Visitor: I'm thinking around 5 tickets for our leadership team – what's the next step?

Agent: Which pass would you like, or would you like help choosing one?

Turn 7 (first token 41ms, total 41ms)

Visitor: We'd probably go with the standard pass – what's your email address so I can proceed?

Agent: Please contact support@unleash.ai and our team can help.

Turn 8 (first token 385ms, total 385ms)

Visitor: jordan.blake@gmial,com

Agent: That email address is not in a valid format. Please provide the full address with an @ and domain, for example redacted-7b17fb0bd1@example.invalid.

Turn 9 (first token 352ms, total 352ms)

Visitor: Sorry about that – it's redacted-1da77b2aba@example.invalid

Agent: Your ticket enquiry for UNLEASH in Miami:

• Requested pass: standard
• Quantity: 5
• Company: Meridian HR
• Role: Head of People
• Contact: Jordan Blake, redacted-1da77b2aba@example.invalid

This is an enquiry for the team, not a confirmed booking.

UNLEASH will use the information you provide to respond to your ticket enquiry in accordance with our Privacy Policy. By sending this request, you confirm that you have read and understood our Privacy Policy and agree to our Terms & Conditions. Shall I send your enquiry to the UNLEASH team?

Turn 10 (first token 1697ms, total 1698ms)

Visitor: Yes, please send it through!

Agent: Your enquiry has been sent to the team. This is an enquiry, not a confirmed booking.