Brief Me: Analytics Overview

Overview

This section guides you through accessing and understanding the analytics dashboard. Your analytics for Brief Me are available within your Copilot Insights dashboard.

How to Access Copilot Insights

  1. Login to your my.moveworks.com account.
  2. Click on the “Analytics” button. If you don’t see it, your Moveworks Super Admin will need to grant you access.
  3. Navigate to “Copilot Insights” on the left hand side menu.
image.png

Understanding Your Analytics

How often feature is used

If you want to get a high level overview on how often this feature is being used, you can use the "What plugins did Copilot use to assist employee?". Look for the Brief Me plugin name. This graph will tell you how often this plugin is being used within your organization.

There are two Brief Me plugins within this graph:

  1. Brief Me (Interactions): This captures all the questions users asked (ex. What capabilities does Moveworks offer?).
  2. Brief Me (Start/End): Where as this plugin will capture the start and end sessions. This includes how many times a user clicked on "Ask questions about file", "Get Help" and # of successful exits.

Who is using this feature and what questions employees asking?

If you want to get a 360 view on the type of questions your employees are asking you can view all the interactions by following these steps:

  1. Make sure you're on "Copilot Insights" page

  2. Click on "View Interactions"

  3. Click on "Plugin Details". Unselect "All" and search for Brief Me. You'll want to select

    • "Brief Me (Interactions) Completed - Success" if you want to see all the questions employees asked.
    • "Brief Me (Interactions) Completed - Incomplete" if you want to see any errors that were captured.
      Errors could occur for the following scenarios:
      • We weren't able to process the file within the copilot response timeframe (90 seconds). It could be the file was too big, our service behind the scenes failed, etc.
      • We weren't able to answer the question within the copilot window timeframe (90 seconds).
        While we do not display this granular information within the your Copilot Insights dashboard, our team is tracking all these issues internally.
    • "Brife Me (Start/End)" if you want to get an idea of how sessions are starting and ending (# of clicks on "Ask questions about file(s)", "Get Help" and "exit")
  4. It may take a few seconds for the data to populate. Once it's populated you'll be able to see which employees are using the feature along with the questions they are asking.

Note: When you are viewing interaction data there is a column called "Domain". The domain classification is only happening on user utterances. Domain classification doesn't work for bot responses so just keep that in mind when looking at your insights.

FAQs

Q: How can I find out who has access to my Copilot Insights dashboard?

A: Anyone within your organization that is a Moveworks Super Admin has access to the Copilot Insights dashboard. Super Admins can specify Admins for various Moveworks applications such as “Analytics”. Super Admins and Admins can see who all have access & can add new users. You can learn more about Roles & Permissions here.

Q: How often is the analytics data updated?

A: The analytics data is updated every 12 hours.

Q: Can I export data from the interactions table?

A: Yes, reports can be easily exported. Click on the download button on the top right corner to download the table as a csv file for more in-depth analysis. Please note the csv file is currently limited to 15K rows.

https://files.readme.io/7d15c77-image10.png

Q: Can I see which files employees are being uploaded for this feature?

A: No, for privacy and security reasons, individual file uploads by employees are not visible to administrators.

Q: Can I set alerts based on specific analytics thresholds?

A: No, currently, the system does not support setting alerts based on analytics thresholds.

Q: Is it possible to integrate the analytics data with other tools or platforms?

A: No, at this time, analytics data cannot be directly integrated with other tools or platforms.

Q: Where can I learn more details about the Copilot Insights dashboard?

A: We have a dedicated documentation page for everything related to our Copilot Insights dashboard, you can check it out here.