METHOD AND APPARATUS FOR NEXT TOKEN PREDICTION BASED ON PREVIOUSLY OBSERVED TOKENS

    公开(公告)号:US20180350232A1

    公开(公告)日:2018-12-06

    申请号:US15993204

    申请日:2018-05-30

    CPC classification number: G06Q10/04 G06Q50/30

    Abstract: An approach is provided for next token prediction based on previously observed tokens. The approach involves receiving an observed time series of tokens, wherein each of the tokens represents an observed data pattern. The approach also involves adding a most recent token from the observed time series of tokens into a variable token set. The approach further involves processing a historical token set to determine a historical token sequence comprising the variable token set followed by a next token. The approach further involves recursively adding a next most recent token from the observed time series of tokens into the variable token set for processing until the next token following the variable token set in the determined historical token sequence is unique or meets a target number of possible predictions. The approach further involves presenting the next token as a predicted next token of the observed time series of tokens.

Patent Agency Ranking