Chatbots hallucinate facts, get talked off-script, and say things no company ever approved — and it's already cost real businesses money, court cases, and headlines. Here's what that actually looks like.
Run independently by someone who spends their day job professionally testing and auditing commercial AI systems — this is that same discipline, turned outward.
Not a theoretical risk — it's already cost real companies money, court cases, and headlines.
Six industries, six companies, same pattern. Most incidents never make the news — these only did because someone happened to notice.
We test how it behaves under pressure — the adversarial, off-script questions a real customer eventually asks.
Invented policies, fees, or figures stated with total confidence.
Legal, financial, or electrical guidance it shouldn't give unsupervised.
Industry-specific rules — discrimination, disclosures, cooling-off rights, and more.
Contradicts the company's own site, or answers inconsistently.
Recognising complaints, threats, and vulnerable customers.
Unnecessary personal info requested, or internal info exposed.
Can an ordinary customer get it off-script?
Accuracy, clarity, and whether it actually helps.
Built on Intercom, Zendesk, or something custom — we test the conversation, not the vendor.
Vendor testing is almost always pre-launch and scripted to the demo. We test the live system, after launch, with the same adversarial and off-script questions a real customer eventually asks — that's usually where the gap shows up.
No. Every test is a normal question typed into your public chat interface, the same access any customer has — no exploits, no unauthorised access, nothing destructive. Before any engagement starts, you sign a short scope-of-work confirming exactly what will and won't be tested.
Every finding in your report includes the exact question asked and the chatbot's exact response, so you can reproduce it yourself. Nothing is summarised away.
The initial exposure conversation is free and non-binding. You keep whatever we've already shown you either way.
Pricing shown is indicative and being validated with early customers.
No self-serve audit tool, no obligation. Leave your email — we'll reply within one business day to arrange a free, no-obligation chat about what an audit would cover.
Short version: we collect only what you give us on this page, we don't sell it, and we don't track you around the web.
What we collect. If you submit the contact form, we collect the email address you provide. That's it — no cookies, no analytics tracking, no third-party ad pixels on this site.
Why. Solely to respond to your enquiry about an audit.
Third parties. Form submissions are processed by Formspree, our form-handling provider, solely to deliver your enquiry to us.
Retention. We keep enquiry emails only as long as needed to respond, then delete them.
Your rights. Email us any time to ask what we hold about you or to have it deleted.
Audits themselves. If you become a client, what we test, capture, and report on your chatbot is governed separately by the signed Authorisation & Scope of Work, not this policy.
Last updated: September 2026. Contact: hello@thesolver.com.au