What is Intent Similarity, and how to resolve it?

Updated 

Overview

Text similarity refers to the measurement of how similar two or more pieces of text are in terms of their content, meaning, or structure. It involves comparing text documents and determining their degree of resemblance or likeness.

Once you've added intents to your intent model, you can resolve overlaps between them by generating a similarity report.

Intent similarity can be Intra-intent or Inter-intent.

  • Inter-Intent Similarity is a machine learning (ML) job designed to detect similarity in expression across different intents.

  • Intra-Intent Similarity is a machine learning (ML) job designed to detect similar expressions within the same intent. Unlike Inter-Intent Similarity, which compares expressions across different intents, this feature focuses on identifying repetitive or overly similar phrases in a single intent.

Steps To Generate a Similarity Report

  1. After creating intents, ​you can resolve overlaps between them using similarity reports.

  2. Click Generate Similarity Report at the top.

Note: It generally takes about 30 minutes to generate a similarity report.

Steps To Resolve Similarity

  1. Click the Open Details icon alongside the desired intent to view the similarity index in the third pane.

  2. Switch to the Expression tab to view all the expressions overlapping with other intents. Click Resolve in the top right corner to resolve them.

  3. On the next window, you can review the similar expressions and add them to correct intent.

Intra-Intent Similarity

The ML job provides a similarity score for each expression in an intent, showing how often it overlaps with others in the same intent. For example, a similarity value of 0.01 would indicate that 1 out of every 100 expressions is very similar to another.

Users can view a list of overlapping expressions and take action:

  • Keep the most representative expression

  • Remove duplicates or near-duplicates

Checking the Intra Intent Similarity Report

  1. Once the intents are created, ​you can resolve overlaps between them using similarity reports. To know more about Intent Creation, read the Create Intent from Scratch.

  2. Click ML Models within the AI Tools of your Conversational AI Application.

  3. Click the desired intent model, hover over the Options icon, and click View.

  4. Click English Expressions present in the right pane of the details screen.

  5. The Intra Intent Similarity report is displayed. To resolve the similarity, click Resolve in the top right corner of the details screen.

  6. You can perform the following actions on the details screen:

    1. View similar phrases within an intent.

    2. Delete redundant ones directly from the interface.

    3. Save the updated training set instantly.

  7. Click Save & Next.