Brief Me: Technology Overview
Brief Me: Technology Overview
Brief Me: Technology Overview
This document covers the entire step-by-step process for Brief Me, starting with file ingestion to snippetization to querying the File Database. Also, we highlight some of the key differentiators in the approach by Moveworks:
Here’s an overview of how Brief Me works within Moveworks AI Assistant.
As we dive into the technical intricacies of Brief Me within Moveworks AI Assistant, we’ll be using this scenario to help you understand various technical concepts that shed light on how Brief Me is working under the hood.
Scenario: It’s open enrollment season at BannerTech
Chris is an employee at BannerTech, a company that builds IoT(Internet of things) devices that help manufacturing companies manage their product inventory. It’s open enrollment season at her company and she has some decisions to make. The HR team at BannerTech recently hosted a open enrollment workshop and shared a resources with employees. She’s overwhelmed with information and doesn’t have time to scroll through each file. Luckily, she has access to Moveworks AI Assistant to help her out.
Chris navigates over to her Moveworks AI Assistant and drops in all the relevant files her HR team has shared regarding open enrollment. This will kick off the first part the file ingestion process (File Ingestion, File Summarizer, Embeddings, Storing your files).
During file ingestion the following actions will execute sequentially:
By analyzing each page of the file, Brief Me is then able to break down the information across all these pages into smaller chunks though snippetization by utilizing an in-house Snippetizer. Each file can have different snippets based on the structure of the file. Using the first 3 pages, the first file (Kaiser_Healthcare_2024.pdf) has 10 snippets while the 3 file (FAQs_Open_Enrollment_2024.docx) has 8 snippets of information. All pages across all files will go through snippetization. Depending on the size of a file, a file can end up having 1,000+ snippets of information .
Now that files have been snippetized (Kaiser_Healthcare_2024.pdf has 10 snippets), there’s 2 pieces that will execute next in parallel:
To put it simply, imagine you’re trying to teach a computer to understand different fruits. In their natural form, understanding and comparing fruits can be complex due to their various characteristics (color, taste, texture, etc.). Embeddings help by converting each fruit into a list of numbers, where similar fruits have similar numbers. This makes it much easier for the computer to grasp the concept of similarity between fruits and perform tasks like grouping similar fruits together.
Utilizing the fruit analogy, just as you might represent various fruits as lists of numbers to make it easier for a computer to understand their similarities and differences, Moveworks AI Assistant employs a similar technique with embeddings for files by leveraging its fine tuned in-house MPNet model for Embeddings.
Each snippet across all files is transformed into embeddings —dense, lower-dimensional vectors that preserve the essence of the information they represent. To put this into simpler terms, think of each snippet being plotted on graph. In the illustration below, each colored dot represents a snippet from each file. By embedding each snippet, Brief Me can quickly identify similarities or relevant information across a vast array of files, making it adept at providing precise, content-aware responses and insights. Again for simplicity we’re only showing the snippets from the first 3 pages of each file. All of these snippets are stored in “Your files database” along with its vector information [File name, Snippet #, Location of Snippet] → [ex. Kaiser_Healthcare_2024.pdf, Snippet 1, .231][ex. Kaiser_Healthcare_2024.pdf, Snippet 1, .231].
The last part of the “Real time file ingestion & processing” is storing the information into a secure database. Each Moveworks customer has its own secure database where all uploaded files are stored. From start to finish the entire process (File ingestion, Embeddings, File Summarizes, Storing files in your database) is lighting fast - it takes roughly ~6 seconds for Brief Me to ingest and process newly uploaded files.
Once the files have been processed, Moveworks AI Assistant will display a confirmation message letting the user know they can start engaging with these files.
With the understanding you’ve developed, let’s walk through a few examples where Chris is asking various questions related to the open enrollment files she uploaded. The first question that Chris may ask is, “Which plan offers an HSA account?”.
Behind the scenes the first thing that Brief Me will do is create a new version of the query that Chris just asked. It will also leverage any use previous questions and responses when it’s creating a new version of the query. Since this is the first question that Chris has asked, Moveworks AI Assistant doesn’t have any previous context so it will only use the query that Chris provided, “Which plan offers an HSA account?”. For such query, the new query that gets generated from “Query Rewrite” could be “Plans with HSA”. Both the original query (”Which plan offers an HSA account?”) and the newly created query (“Plans with HSA”) are sent over to the Reasoning Engine to determine the next step.
In general this step is beneficial whenever there’s previous context. Let’s say the next question Chris where to ask was, “How do I set that up”. The new query that “Query Rewrite” creates could be “Setup HSA” since the first question was related to “HSA accounts”. Notice that Brief me with Moveworks AI Assistant was able to accurately answer the question without Chris needing to include “HSA” in her question.
The Reasoning Engine serves as the analytical brain of Moveworks AI Assistant, where the real magic happens. After receiving both the original query (“Which plan offers an HSA account?”) and the query rewrite response (“Plans with HSA”), the engine springs into action.
The engine’s primary task is to accurately interpret Chris’s inquiry, choosing between a comprehensive review of the entire file or a targeted search within specific sections (Does I need to look at every page of a file, or can I find the answer in just a part of a file? ). This decision rests on the nature of the query, which dictates the best suited approach—whether summarizing the file to capture its essence, engaging in an in-depth Q&A for precise answers, or comparing specific themes across a series of files.
Moveworks AI Assistant has to pick between 2 options. It doesn’t need to do both:
Considering Chris’s question and the simpler query provided, AI Assistant realizes it doesn’t need to check the entire file. It heads over to the “Your files database” and looks for any mention of “HSA” in the file snippets.
This search reveals that “HSA” pops up in four of the five files. In the illustration below, there were 6 relevant snippets on this topic (outlined in a pink circle):
Now that Moveworks AI Assistant has found the most relevant snippets, it has to figure out how to best answer the original question, “Which plan offers an HSA account?”. Moveworks AI Assistant will assess the snippets from these files to deduce which one truly holds the answer.
Given the healthcare plan context of Chris’s question (“Which plan offers an HSA account?”), 📔Cigna_Healthcare_2024.pdf becomes the standout document.
While multiple snippets across files mention HSA, the snippet from the 📔Cigna_Healthcare_2024.pdf is the most relevant and hence why Moveworks AI Assistant provided the following answer.
Brief Me, integrated within Moveworks, distinguishes itself as a leading solution through several advanced technical strategies:
Real-Time File Ingestion & Processing: Unlike traditional search systems that operate through offline indexing or rely on a Live API, Brief Me revolutionizes this space by performing real-time file ingestion and processing. This approach reduces latency and allows users to quickly start engaging with the file.
Embeddings-Based Search: Standard search systems typically scan all files within an index to respond to a query, which, in organizations with vast document repositories (e.g., 10,000 files), can lead to suboptimal accuracy and relevance due to the sheer volume of data. Brief Me’s approach, however, confines its search to user-uploaded files and employs an embeddings-based method. One of the benefits that comes with leveraging an embeddings based search approach is the ability to look at neighboring snippets for queries - this is especially helpful when the answer to a question doesn’t entire exist within one snippet (a paragraph). Sometimes the answer to a question is dependent on the information exists in previous or subsequent paragraphs of the. most relevant snippet (a paragraph). This strategy enhances the search accuracy because its’ able to quickly analyze the most relevant snippets across all the files.
Selective Analysis by the Reasoning Engine: The Reasoning Engine’s advanced capability to discern whether to analyze an entire file or focus on specific sections is crucial. Recognizing that it’s unnecessary—and inefficient—to always engage with the full content of a file, this ensures that only the most relevant data is utilized for generating responses, streamlining the process for faster and more accurate outcomes.
Grounded Responses: Moveworks AI Assistant stands by the principle of grounded responses. Every piece of information it provides is directly derived from the content of the files uploaded by the user. This ensures that the guidance and answers AI Assistant delivers are inherently reliable and trustworthy, making it an invaluable aid to users navigating through their document collections.
These cutting-edge features together make Brief Me within Moveworks AI Assistant the stand out solution, raising the bar for how we search and analyze documents in today’s crowded market.
Check out our Brief Me: Use Cases & Scenarios page to look at other examples that highlight various capabilities.