Wysdom News

04 Jul

5 steps to training your new Bot


Ian

By Ian Collins
Approx. read: 10 mins.

So you’re thinking of implementing a Bot like every other company on the planet but there is this issue about training the damned thing. There has been an endless stream of coverage about all of the wonderful things Bots are going to do for business by automating conversations with customers.  The problem is, Bots are only as good as the training that goes into them and training isn’t something you just knock off in a few days.

Many Bot startups seem to want to treat Bots like an IVR, choose the top 20 use cases and train your Bot around those needs.  Considering the IVR is probably the most hated piece of technology invented in the last 50 years, replicating that process is probably a horrible idea.

Very few, if any, Bot vendors have actually operated these things out in the wild with millions of customer interactions over a number of years so it makes sense that we’re not yet hearing about the best practices when it comes to training a Bot.  The reality of training a Bot is a little more complex than might be obvious at first glance.

At the highest level you need to consider all of the various channels that customers are using to contact you (Messenger, Twitter, Kik, WeChat, Web Chat, Mobile apps, Alexa, etc…), the unique UI capabilities of each channel and multiple languages to be supported.  You definitely don’t want to train in multiple systems.

This is probably a little more complex than just plugging in the top 20 use cases, let’s look at the best way to train a Bot to deliver real value to your enterprise and customers.

Bot

Step 1: Pre-training your Bot.

This is what many Bot companies are pitching as the whole training program, when it is really only the first step of a real training plan.  This is where you go to your customer care or tech support department and see what they think are the top reasons your customers are contacting your company.

By sampling the chat logs, call recordings and digging through the typical support material that the reps use you will get closer to understanding the customer intent.  This is a decent place to get started on training your Bot.

Step 2: Analysis of all customer interactions.

Every day your customers are telling you what they want to know and what they really care about.  Many Bot companies are assuming that you will know what your customers want and if you don’t that it is your problem to figure it out.

A tool that analyzes customer questions in real time is a key piece of any Bot solution. The analysis will tell you what your customers actually want to do with your Bot and will let you focus your training efforts where it pays the biggest dividends; this is probably the most important part of any Bot training framework.

Step 3: Train the Bot.

With all of the rich information coming from the analytics where to train is obvious. A good Bot solution will now let you train in one location and take into consideration each channel’s capabilities and limitations. What you present in FB Messenger won’t work in a pure text Bot, and what you can present in Twitter may not work in your web chat UI.

A well-architected system will let you train for both conversational and Q&A type of channels in one system.  Multiple languages should be automatically generated or updated if you have created a new scenario or just updated an existing one.  Training multiple Bots to solve this problem is insanity as described in this previous VentureBeat article.

Measure

Step 4: Measure the effectiveness.

Use every question from every customer from every channel every day to determine how effective your Bot is. There are many ways to measure the level of satisfaction of your customers during their interaction with the Bot.  Over time you will determine normal thresholds for each parameter and then can use anything outside the norm as an indicator of failure.

Your false positive rate should be monitored closely here.  Delivering the wrong answer is far worse than not delivering an answer at all so this is critical to measure.  If you are delivering the wrong answers more than 3% of the time your system should be taken back to the drawing board.

Step 5: Continuously improve.

Training your Bot will never be finished.  Even if you have a simple Pizza ordering Bot you’re going to have to continuously learn new language from your customers about how they want to order, add new channel support and new products.  If you have a more complex business and are using your Bot for customer service then you should plan to invest a considerable effort in ongoing training.

Don’t get caught up in the Bot hype and deploy something that is going to create more work in the longer term.  A fully thought out Digital Care strategy will provide large customer satisfaction and economic benefits.