公开(公告)号：US20250103809A1

公开(公告)日：2025-03-27

申请号：US18371344

申请日：2023-09-21

Applicant: Rubrik, Inc.

Inventor： Seungyeop Han ,  Alex Rand

IPC: G06F40/284 ,  H04L51/18 ,  H04L51/216

Abstract: A method for data management is described. The method includes obtaining data associated with a communication session between a user and a communication service of a data management system (DMS). The method further includes generating a prompt that includes some or all of the data associated with the communication session. The method further includes selecting a large language model (LLM) from a set of LLMs available to the communication service based on a token size of the prompt and a token window size of the LLM. The method further includes transmitting the prompt to the selected LLM and receiving a response from the selected LLM. The method further includes using data from the response in the communication session. In some implementations, if the token size of the prompt exceeds the token window size of the LLM, the DMS may select a different LLM or modify the contents of the prompt.