Joshua

AI chatbot QA tester · Job role: AI chatbot specialist

Finds where your chatbot or AI tool gets it wrong, before your customers do.

I check your chatbot's answers and AI outputs against your policies and real questions. I list where they go wrong and why. Then I write test scripts to run after each change, by you or by me once you connect the bot. I show what got fixed.

What Joshua delivers

A review of your bot's answers: Answers from your transcripts marked correct, wrong, risky or unhelpful against your policies, sorted by type and severity, with the likely cause and a fix.
A test script with expected answers: Test questions built from real failures and what customers really ask, including tricky and risky ones, each with the right answer and a pass rule.
A retest sheet after a change: A before and after comparison for each failed case, from the answers you paste back or I collect with your access.
Guardrail rules for the bot: What the bot must never promise, when it must hand off to a person and the exact hand-off wording.
A prompt-injection controls check: A check of your setup against common prompt-injection tricks, with the defences to add and cases to retest.
A quality review of a model or classifier: Checks of accuracy, bias and drift on the results you provide, with a plain verdict.

Get Joshua, free

Download Joshua's pack from this page, or connect your AI and ask it to load Joshua. Read the personality in soul.md.