AI

Sentiment Analysis for Bot Conversations

Customers are using channels such as Facebook Messenger as a place where to complain when their online order is delivered late. Therefore, companies have started to trust chatbots for handling these issues. Can you see the potential of applying sentiment analysis to chatbot conversations?

When customers have a particularly good or bad experience in a hotel, it used to be Facebook wall or Twitter timeline the place where to complain about it. Lately, they become used to doing it directly on the TripAdvisor page, Google sites or Amazon comments about the product. But now, if you are writing a complaint in the Facebook Messenger channel of a brand, you likely will see how a bot handles it. This is a terrific opportunity for chatbots and one of their strongest advantages.

 

Benefits of bots as a customer support channel

  • Data ownership: the complaints are now arriving to a channel the business can control, that is, they can check the logs, knowing they only talk about their product or service, unlike social media platforms where the message gets mixed with other conversations.
  • Avoiding blackmail: It is a private channel, so there’s no risk of other users taking advantage of the situation of one of them and complaining only to blackmail the business.
  • CRM connection: you will not have to manually check if a person is a client or not, their product reference number, or the status of their delivery… all those steps are automatic in the case of a bot. So, giving away compensation to someone who doesn’t deserve it is another avoided risk.

So, if human input in a human-chatbot conversation is the new complaint in social media, how about applying what we were applying to social media messages? That is, sentiment analysis for bots conversation analytics. 

Applying sentiment analysis to bot conversations

As a picture is worth a thousand words, we manually collected negative and positive reviews (not much, only 93 paragraphs) from TripAdvisor about a bunch of hotels in San Francisco and applied the Bitext sentiment API to see if some insight came up from the graphics with such a scarce dataset. The results are truly enlightening!

Score per topic

Sentiment analysis would be a powerful tool for a hotel manager to know their business’ strengths and weaknesses. For example, if these comments belonged to a single hotel and you were in charge of it, of course you shouldn’t  worry about the staff, the breakfast or the wifi, instead you should pay attention to whatever happens with the bathrooms (bathroomtoilet) and the maintenance (carpetcarpetingbed cover), or think about soundproofing (areastreetnoisenighttraffic).

 

Opinions per topic

Another interesting relation that can illustrate what customers think of a service, beyond negative and positive scores, is the opinions per topic. It allows to see what topics are more popular, no matter the score and the specific words used to describe each topic. 

This is gold for the hotel communication team to know if the message they’re sending corresponds with their customers’ real experiences.

The little circle shows the topics and the surrounding one shows the opinions per topic. Sizes respond to the frequency of both in the comments corpus

 

As you can see, these variables give you a lot of possibilities. We encourage you to try it with corpora representative of different activity fields, sizes, and languages (ES, CA, FR, DE, IT, PT, NL) and share the insights you extract

admin

Recent Posts

From General-Purpose Models to Verticalized Enterprise GenAI Use Cases

Verticalization is a necessary step for deploying AI in the enterprise. But what does verticalizing…

2 days ago

Case Study: Finequities & Bitext Copilot – Redefining the New User Journey in Social Finance

Bitext introduced the Copilot, a natural language interface that replaces static forms with a conversational,…

2 months ago

Automating Online Sales with Proactive Copilots

Automating Online Sales with a New Breed of Copilots. The next generation of GenAI Copilots…

3 months ago

Taming the GPT Beast for Customer Service

GPT and other generative models tend to provide disparate answers for the same question. Having…

6 months ago

Can You Use GPT for CX Purposes? Yes, You Can

ChatGPT has major flaws that prevent it from becoming a useful tool in industries like…

7 months ago

Why Do You Need to Fine-tune Your Conversational LLM with 100’s (If Not 1,000’s) of Examples?

If data is the oil of the AI industry, we are running out of data…

7 months ago