Pre-fetching results from large language models
摘要:
Systems and methods for pre-fetching results from large language models (LLMs) are provided. The method includes acquiring a context of an interaction between a user and an Artificial Intelligence (AI) character; predicting, based on the context, one or more anticipated words to be uttered by the user; generating, based on the one or more anticipated words, at least one query to an LLM; providing the at least one query to the LLM; generating, based on at least one response obtained from the LLM, an anticipated reply of the AI character model to the one or more anticipated words to be pronounced by the user; receiving one or more words uttered by the user; determining that a level of a discrepancy between the one or more words and the one or more anticipated words is below a predetermined threshold; and providing the anticipated reply to the user.
信息查询
0/0