Bot audit
How we audit a bot on a client's website, a sample report and a training before/after example.
Audit of an installed bot: on estimate. A package price with the scope of the audit. Details
How the audit works
- Before we start, we agree on the bot's tasks, the sources of correct answers and how to send test requests.
- Using the link to the website, we check what a visitor sees.
- We check typical customer questions, follow-up questions, answers when information is missing and request delivery to the recipient.
- Finding the cause of a failure and repairing it may require access to settings, code or logs.
What the report contains
Every significant failure is described with the fields below. Observation and probable cause are stated separately.
Training before/after example
Training example. The scenario and answers were written to demonstrate the method; this is not a report about a real client.
Scenario: A visitor asks for the price and tries to leave a contact.
Before
-
You
How much does a website bot cost?
-
Bot
A website bot costs 5,000 rubles.
-
You
I want to order. My phone is +7 900 000-00-00.
-
Bot
Thank you! We will contact you.
After
-
You
How much does a website bot cost?
-
Bot
We price it on estimate. It depends on the option — text, voice or voice with a character — and on integrations. Tell me about your website and what the bot should do, and I will prepare a request for an estimate.
-
You
I want to order. My phone is +7 900 000-00-00.
-
Bot
I have prepared a request. Service: bot for an existing website. Contact: +7 900 000-00-00. Please check the description and the contact and press “Send”.
-
Note
After “Send” is pressed, the site saves the request and only then shows its number.
Sample report
| Original question | How much does a website bot cost? |
|---|---|
| Expected result | “On estimate” and what is needed for the estimate. |
| Actual result | Quoted 5,000 rubles. |
| Consequences | A false price promise and a dispute with the client. |
| Priority | High |
| Observation | The bot quotes an amount that is not in the price list. |
| Probable cause | The bot has no current price list, so the model makes up the answer. |
| Original question | I want to order. My phone is +7 900 000-00-00. |
|---|---|
| Expected result | A request summary, a request to check the contact, a request number after saving. |
| Actual result | Replied “We will contact you”; no request was created. |
| Consequences | A lost client. |
| Priority | Critical |
| Observation | There is no entry in the request log. |
| Probable cause | The bot is not connected to request intake. |
Order an audit
We reply to requests within one business day.