TABLE OF CONTENTS
- How to Test Your Bot
- Successful Responses
- Responses That May Need Customization
- Customize Based on Testing
- New Custom Questions
- Custom Question Best Practices
- Testing the IDK Response
- Testing the Explore Feature
- Multilingual Chatbots
The chatbot was built to speak to students, so test and customize it using student language instead of industry-based terms. (i.e. instead of testing “How is R2T4 calculated?”, test “Why was my aid returned?”)
How to Test Your Bot
From the top-right of the admin’s homepage, click the “Test My Bot” button.
2. The chatbot pops open and is fully interactive. Enter questions that you would like the chatbot to be able to answer, such as your top FAQs from your students and parents.
Examples of the chatbot functioning successfully as designed:
It answers the question correctly from the Knowledge base.
It gives relevant suggestions.
It provides search results from your website that answers the question.
When we set up your chatbot, our team creates an index of your website to identify relevant sections as they pertain to the type of chatbot purchased. Similar to a textbook, the index serves to identify where key information by topic is located.
Congrats!! If testing results in any of these scenarios, your testing is complete and you can move along to the next question.
Responses That May Need Customization
Responses may need to be adjusted if:
The chatbot does not know the answer also known as an IDK ("I Don't Know") to an applicable subject-related question.
Add a new custom question with the correct answer by clicking the Add A Response button. Further details on custom questions, including best practices, are outlined in the Customize Based on Testing section below.
The chatbot gives a response that you would like to customize.
If the existing answer is not correct for any of your school’s departments or audiences, then the answer needs to be edited with the correct information.
You will see an Edit Response button appear at the lower right corner of that interaction.
Click the Edit Response button and that Knowledge base question will pop up in a window for you to edit.
The chatbot gives suggestions that do not help answer the question.
Since the chatbot searches for Knowledge base answers before providing suggestions, add a new custom question with the correct answer.
The chatbot returns a website search result that does not contain the correct answer on that page.
Add a new custom question with the correct answer.
Curious about how Ocelot uses Artificial Intelligence (AI) to return Knowledge base responses? Review our AI Model document for details and FAQs!
Congrats!! You’ve just increased the growth of your chatbot’s Knowledge base and users will find correct answers faster.
Customize Based on Testing
If a testing response comes from the Knowledge base, an Edit Response button will appear below the response.
By clicking on the Edit Response button, you will be brought to that question/response in the Knowledge base, where you will have the opportunity to edit/override that response as desired.
A few notes on editing questions and responses:
Variables, such as “!facontact-number” in the example above, have custom values that can be edited in the Settings area. Contact information variables, such as !facontact-number, are not displayed in the admin and must be adjusted by your Client Success Manager (see more about variables in the Variables section).
Hitting "Enter" after a line will create a space between each line. In order to reduce this spacing format, use bullet points and separate them out with "Alt" + "Enter" instead
If the Question Expires button is activated, you must enter the date when you wish the question to expire. Upon expiration, that question/response will be deleted from the system.
If a Review Date is saved, that question will be displayed in the Awaiting Review area 7 days prior to the review date and the system will notify admin users that the question/response needs to be reviewed for accuracy.
Customized questions will move into the Moderation Queue for up to 2 business days to be reviewed by Ocelot and then will go live and be displayed in the Custom Questions area.
Once custom questions have been processed by Ocelot, the view screen will show what libraries and categories the question is associated with in the Knowledge Base.
Add a Response
If a response does not exist in the Knowledge base (IDK), an Add a Response button will populate under the chatbot’s IDK response.
By clicking on the Add a Response button, you will be brought to the Add New Question area, where you can type in your question and desired response. Additional details related to creating new questions are detailed in the New Custom Questions section below.
New Custom Questions
To create custom questions from scratch, open the navigation pane..
Read through the Custom Questions Best Practices section, located below, before customizing any questions. The What are the best practices for writing questions and responses? article may also prove helpful as you customize questions.
To create a custom question:
Click the Create Question button from the navigation pane.
- Enter your primary question on the first line.
- Enter your response.
Utilize the hyperlink feature to link text instead of including full URLs. Check the “Open link in new window” box for a better user experience. If the new site does not have the chatbot embedded, the user can easily close out the new tab and return to the chatbot.
A note about line spacing: hitting “Enter” after a line will create a space between each line. In order to reduce this spacing format, use "Shift" + "Enter" instead.
Finally, set the Review Date if you want the system to notify you on that date to review the question to ensure the information stays accurate.
To edit an existing custom question:
From the left-hand pop-out navigation pane, visit the Knowledge base Custom Questions section to find the question.
Open the question to be able to edit the existing answer:
Click the “Edit” button and create your new answer.
Saved questions will move into the Moderation Queue, where they will go through a review cycle with internal Ocelot team members before they are approved.
Custom Question Best Practices
Each library comes preloaded with hundreds of questions and responses, so your chatbot can start helping users right away. You can also create custom questions for inquiries that are not answered by the General library content. Creating strong custom questions based on user needs and thorough testing will enhance your chatbot’s performance. Here are tips to help you create effective custom responses and ensure AI compatibility.
Testing the IDK Response
When the chatbot cannot provide a response to a user’s question/input, it will respond with an IDK (“I Don’t Know”) and ask if the user would like to contact the office. In order to test this function, ask the chatbot something it is not designed to answer. Our favorite is “Why am I hungry?”
If the user says yes, the chatbot will ask for the applicable office.
Once an office is chosen, the chatbot will activate the IDK Response, which is either to:
Utilize the IDK intake form, or
Display your contact information to the user (this is what a new chatbot defaults to unless a chatbot admin changes the behavior settings).
The IDK intake form will ask the user for the following information:
Anything else they would like to add
Once complete, a transcript of the entire conversation will be sent to the email you entered on the set-up form, followed by an offer for the user to download a copy of the chat transcript.
Testing the Explore Feature
Ocelot’s chatbot features a functionality we call “Explore,” which provides additional options through the A.I. for the user to choose from every time a question is asked. Suggestions (possible helpful responses from the Knowledge base), Videos (from the video portal that contains possible related content), and Links (pages from your website with possible related content) will display as options for most interactions:
View our Explore Feature Overview for additional details.
Testing Multilingual Chatbots
If your chatbot is multilingual, the applicable languages can be accessed via 2 ways:
Click on the industry-standard globe icon at the top right corner
Start typing the applicable language into the chatbot and it will shift to that language’s mode.
Additional languages utilize a built-in translator, so there are no additional Knowledge bases to maintain!
When you access actual student conversations in the Interactions area of the admin, use the globe icon to translate them back into your native language.
Once you've completed this implementation step, embed your bot onto your web pages!