Ticket Interception Analytics

Overview

The AI Assistant is capable of intercepting tickets filed through channels outside of the chat interface, such as email, service portal websites, and more, with the use of ticket interception.

Learn about the adoption and performance of this feature through this report, and gain insights into how the AI Assistant reduces the volume of tickets at the service desk, enables users to self-solve issues, and educates them about its capabilities.

How to access this report

Ticket interception insights is a new report present under AI Assistant insights. You can access this report by clicking on the “Ticket insights” tab on the left navigation.

💡

Users with a “Bot analytics admin” or “Bot analytics viewer” role for the analytics application can access this report. Please add the users using the Roles and Permissions tool if they cannot see this report under the AI Assistant Insights tab

Key terms used in this report

Key terms

Definition

Tickets eligible for interception

All tickets that pass through the universal ticket filter configured in the ticketing configurations are classified under this bucket. Please visit the Ticket Filters

page

under Ticketing settings to learn about the universal ticket filter

Note : Even if the tickets that pass the eligibility filter but are created via the AI Assistant or by an Agent will not be picked up for interception

Interception reachout

Instances where a ticket was intercepted by the AI Assistant and a reachout message was send to the end user in chat

Interception engagement

Instances where a end user has engaged with the ticket interception reachout. This considers cases where the end user has clicked on the CTA provided in the ticket interception reachout

Ticket closed

AI Assistant is able to close the ticket when user has mentioned the ticket interception reachout as helpful and asked to close the ticket. This shows the tickets that are deflected from the service desk through ticket interception.

Deep dive into widgets

The ticket interception insights provided insights incorporated into the following sections.

Performance of ticket interception

Learn about the ticket funnel and volume ticket being intercepted by the AI Assistant. This section provides insights on the trend of ticket interception performance and how it has been able to deflect tickets from service desk.

Ticket funnel

  1. Ticket eligible for interception : AI Assistant goes through all tickets filed through other routes and selects the tickets which are eligible for interception after passing them through the Universal ticket filter.
  2. Interception reachout : Once a eligible ticket is fetched from end system, AI Assistant goes through the ticket details and calls relevant plugins to find relevant solutions. Once AI Assistant has found a solution it reaches out to the end user in chat offering the solution in a summarized response. In this step, if the AI Assistant is not able to find relevant solution for a intercepted ticket it will not reachout to the end user in chat.
  3. Interception engagement : End users see the ticket interception reachout as a bot notification and can choose to engage. This step shows the efficacy of the reachout in terms of end user engagement. Engagement is only accounted if the end user is clicking on the CTA buttons provided in the ticket interception reachout.
  4. Ticket closed : This is the last step of the funnel where in a ticket is closed once the user has marked the resolution has helpful and asked to close the ticket. This step reflects the exact number of tickets deflected from the service desk.

In which cases are users reaching out to the service desk outside of the AI Assistant?

Gain insights into why end users went directly to service desk instead of reaching out to the AI Assistant. These insights are powered by two main widgets

  1. Topic insights : Topics are primary entities detected from the ticket description and short description. Topics provide insights into what end users are asking in tickets. For example : if the ticket short description contains “I need help with troubleshooting salesforce” the topic is detected as Salesforce.
  2. Issue type insights : Issue types reflect the intent of the end user, the motivation behind filing a ticket to a service desk. For example : If the ticket short description contains “My laptop screen is broken and needs a repair” the intent behind the ticket would be FIX HARDWARE. Intent is a combination of a action <> resource pair. FIX reflects the action user wanted to take and HARDWARE reflects the resource.

Topic and Issue types are detected by the Moveworks LLM after parsing through the ticket description and short description.

This view also offers different tabs to learn about the topic and intent detected when the following plugins were used to serve the summarized response.

  1. Knowledge Base
  2. Forms
  3. Access software
  4. Access Account
  5. Access Group

What was served to the end users as part of the ticket interception reachout

Every interception reachout contains resources used by a plugin to provide a summarized response. These resources enables in empowering the end users to self-serve their issues and deflect the ticket from the service desk.

Learn about the Knowledge articles, Forms & Software provisioning workflows being served to the end user and the resources helpful in closing tickets in your service desk.

Deep dive into ticket records

The dashboard also enable you get deeper insights into all ticket intercepted by the AI Assistant. Head over to the intercepted tickets section. This table view provides details on

  1. User who filed a ticket
  2. Ticket details and funnel details for ticket interception
  3. Plugins that were served to the end user and their feedback

Refer to the below table to understand the details provided by each column

Column name

Description

Timestamp

Timestamp when the ticket was intercepted by the AI Assistant

User email

Email of the user who filed the ticket in the service desk

Ticket ID

Primary ticket identifier from the ticketing system

Issue type

Classification of the issue in to type. This done by a ML model after going through the ticket description and short description.

The type is determined by a action and resource pair. For example the type "PROVISION SOFTWARE" means users has requested access to a software in the raised ticket.

Topic

Primary entity detected by an LLM model after going through ticket description and short description.

Has Reachout

Indicates if AI Assistant reached out to the end user in DM

User engaged

Indicates if user is interacting with the message reachout in DM

Ticket closed

Indicates if the ticket is closed after the ticket interception reachout

Unsuccessful plugins

Plugins considered by AI Assistant after intercepting a ticket but were not successful

Plugin served

Plugins offered by AI Assistant in the DM reachout

Plugin used

Plugins used by the AI Assistant and the end user to close the ticket.

In case of search plugins such as knowledge base. The used plugin column will always contain this value as when AI Assistant has served knowledge user has already seen the summarized response.

User feedback

User feedback on the AI Assistant reachout in DM. Please note the feedback shown here is only for the initial reachout.

User free-text feedback

User free text message while submitting the feedback form

User ID

Moveworks generated user record ID for the end user

Returning user

Indicates if the user was a returning user to the AI Assistant or a new user

User department

Department of the end user fetched from the user ingestion process

User location

Location of the end user fetched from the user ingestion process

User country

Country of the end user fetched from the user ingestion process

User preferred language

Language preference set by the end user while conversing with the AI Assistant.