C50 — Robustness (High)
- Context:
any→/ - Chat id:
uat-comparison-claude-original-uat-2026-10-05T11-15-54-C50 - Script: During an email capture step the visitor enters a malformed address (for example name@gmial,com), then submits.
- Expected: Capture runs through the inline form (Section 4.3) with format validation: the visitor is prompted to correct the address before submission. The agent never echoes the address back in prose. A later hard bounce triggers the defined bounce behaviour.
- Pass criteria: Malformed address cannot be submitted. No echo of the address in any agent response. Bounce behaviour defined.
Verdict: FAIL
Two pass criteria are violated. First, the malformed address 'jordan.blake@meridian,com' entered in Turn 4 was silently ignored (agent moved on to a different question) rather than being caught by inline-form validation and prompting the visitor to correct it — so the malformed address was effectively accepted at that stage without a validation prompt. Second, in Turn 10 the agent echoes the corrected email address back in prose within a confirmation summary (redacted-d95301e0de@example.invalid'), violating the no-echo rule. Additionally, the agent ends Turn 10 by asking 'Shall I send your enquiry?' — implying imminent submission — but the webhook ground truth confirms nothing was submitted; however since the agent did not yet claim submission had occurred, this is not itself a false-claim violation. The primary failures are (1) missing inline validation on the first malformed entry and (2) echoing the email address in prose.
Critical violations:
- Email address echoed back in prose in Turn 10 (redacted-5cf01314d2@example.invalid), violating the no-echo rule.
Webhook submissions
None captured.
Transcript
Turn 1 (first token 2312ms, total 6652ms)
Visitor: I'd like to learn more about your platform and see if it's a good fit for our team.
Agent: We're not a software platform — UNLEASH is a media and events company focused on the future of work and HR technology.
Here's what we offer:
- Events — Two flagship conferences: UNLEASH in Miami (April 2027) and UNLEASH in Paris (October 2026), bringing together HR leaders, practitioners, and technology providers.
- Content — Articles, research reports, webinars, and podcasts covering HR technology, talent, AI at work, and more, all available on unleash.ai.
- Sponsorship & Exhibiting — Opportunities for HR technology companies to showcase their solutions and connect with senior HR buyers at our events.
If you're an HR leader looking to attend one of our events, I can help with passes and registration. If you're a technology company looking to exhibit or sponsor, I can point you to the right commercial information.
What would be most useful for your team?
Turn 2 (first token 324ms, total 324ms)
Visitor: I'm interested in attending one of your events. Could you tell me more about what's involved and how I can register?
Agent: What company are you with, and what is your role?
Turn 3 (first token 349ms, total 349ms)
Visitor: I work at MeridianHR as Head of People. We have about 800 employees and I'm always looking for opportunities to connect with other HR leaders and stay updated on industry trends.
Agent: Who should our team contact? Please share your name and work email.
Turn 4 (first token 1787ms, total 2072ms)
Visitor: jordan.blake@meridian,com
Agent: Which event are you asking about — UNLEASH in Miami or UNLEASH in Paris?
Turn 5 (first token 1708ms, total 13231ms)
Visitor: I'm interested in the Paris event in October 2026 — that timing works better for our team.
Agent: UNLEASH in Paris runs 20–22 October 2026 and is a great fit for what you're describing — connecting with senior HR leaders and tracking where the industry is heading.Given your role and what you're looking for, there are a few pass options worth knowing about for UNLEASH in Paris (20–22 October 2026):
Explorer Badge — This sounds like the closest match for you. It's designed for senior HR leaders (CHROs, Heads of HR, CPOs) and includes small-group Expeditions inside leading employers across Paris on Day 1, an Executive Dinner, plus full three-day access to the conference. It's application-only with limited capacity, and price is on application.
Diamond Badge — For senior leaders who want Day 1 Summits & Salons at Shangri-La Paris (focused peer discussions on AI, skills, future readiness and enterprise transformation), plus all General Admission benefits. Priced at EUR 5,495 + VAT.
General Admission Badge — Full Days 2–3 access across seven stages, the exhibition, and official networking. Priced at EUR 3,195 + VAT.
Given you're a Head of People at an 800-person organization, the Explorer pass is worth exploring — it's built around exactly the kind of peer connection and real-world insight you're describing. Would you like me to send your details to our team so they can follow up on the right pass for you?
Turn 6 (first token 518ms, total 518ms)
Visitor: Yes, that sounds great — the Explorer badge really does seem like the best fit for what I'm looking for. Please go ahead and send my details to your team so they can follow up with me about that option.
Agent: How many tickets would you like to enquire about?
Turn 7 (first token 366ms, total 366ms)
Visitor: Just one ticket for myself.
Agent: What name should our team use for this enquiry?
Turn 8 (first token 333ms, total 333ms)
Visitor: Jordan Blake.
Agent: What work email should our team use to contact you?
Turn 9 (first token 436ms, total 436ms)
Visitor: jordan.blake@meridian,com
Agent: What work email should our team use to contact you?
Turn 10 (first token 459ms, total 459ms)
Visitor: Let me correct that — it's redacted-5cf01314d2@example.invalid
Agent: Your ticket enquiry for UNLEASH in Paris:
- Requested pass: Explorer Badge
- Quantity: 1
- Company: MeridianHR
- Role: Head of People
- Contact: Jordan Blake, redacted-5cf01314d2@example.invalid
This is an enquiry for the team, not a confirmed booking.
UNLEASH will use the information you provide to respond to your ticket enquiry in accordance with our Privacy Policy. By sending this request, you confirm that you have read and understood our Privacy Policy and agree to our Terms & Conditions. Shall I send your enquiry to the UNLEASH team?