DYNAMIC LOW-RANK ESTIMATION FOR TRANSFORMER-BASED LANGUAGE MODELS

    公开(公告)号:US20250029005A1

    公开(公告)日:2025-01-23

    申请号:US18669413

    申请日:2024-05-20

    Abstract: A method includes accessing a plurality of weight matrices of a machine learning model. The method also includes, for each weight matrix, decomposing the weight matrix into a U matrix, an S matrix, and a V matrix using singular value decomposition. The S matrix is a diagonal matrix, and a singular group corresponds to each element in the S matrix. The method further includes, for each weight matrix, determining an importance score of each singular group. The importance score of the singular group represents a change in loss if the singular group is removed from the machine learning model. The method also includes, for each weight matrix, ranking the singular groups across the plurality of weight matrices based on the importance scores. In addition, the method includes, for each weight matrix, identifying one or more of the singular groups to prune based on the ranking of the singular groups.

    System and method for generating aspect-enhanced explainable description-based recommendations

    公开(公告)号:US11995564B2

    公开(公告)日:2024-05-28

    申请号:US16246775

    申请日:2019-01-14

    CPC classification number: G06N5/04 G06F16/9024 G06N20/00

    Abstract: A recommendation method includes determining one or more aspects of a first item based on at least one descriptive text of the first item. The recommendation method also includes updating a knowledge graph containing nodes that represent multiple items, multiple users, and multiple aspects. Updating the knowledge graph includes linking one or more nodes representing the one or more aspects of the first item to a node representing the first item with one or more first edges. Each of the one or more first edges identifies weights associated with (i) user sentiment about the associated aspect of the first item and (ii) an importance of the associated aspect to the first item. In addition, the recommendation method includes recommending a second item for a user with an explanation based on at least one aspect linked to the second item in the knowledge graph.

    SYSTEM AND METHOD FOR CONTINUAL REFINABLE NETWORK

    公开(公告)号:US20230177332A1

    公开(公告)日:2023-06-08

    申请号:US18061216

    申请日:2022-12-02

    CPC classification number: G06N3/08

    Abstract: A method includes accessing, using at least one processor of an electronic device, a machine learning model. The machine learning model is trained by directing a gradient direction of gradients to one or more flat local minima and using a dynamic learning rate for one or more additional tasks. The method also includes receiving, using the at least one processor, an input from an input source. The method further includes providing, using the at least one processor, the input to the machine learning model. The method also includes receiving, using the at least one processor, an output from the machine learning model. In addition, the method includes instructing, using the at least one processor, at least one action based on the output from the machine learning model.

    SYSTEM AND METHOD FOR INTERACTIVE DIALOGUE

    公开(公告)号:US20230055991A1

    公开(公告)日:2023-02-23

    申请号:US17674258

    申请日:2022-02-17

    Abstract: A method includes receiving natural-language input from a user. The method also includes receiving, from an information source, one or more candidate recommendations as potential responses to the natural-language input. The method further includes determining, based on a similarity between the natural-language input and a selected candidate recommendation among the one or more candidate recommendations, whether to respond to the natural-language input with natural-language output that includes (i) the selected candidate recommendation or (ii) a query for additional user input. In addition, the method includes providing, based on the determination, the natural-language output to the user.

    SYSTEM AND METHOD FOR IMAGE INPAINTING BASED ON LAYOUT-GUIDED PRE-PROCESSING ATTENTION MECHANISM

    公开(公告)号:US20220156896A1

    公开(公告)日:2022-05-19

    申请号:US17503169

    申请日:2021-10-15

    Abstract: An inpainting method includes obtaining an image including an object having a delicate shape and identifying a target region within the image, where the target region is adjacent to the object. The method also includes using a first mask to separate the image into a number of semantic categories and aggregating neighboring contexts for the target region based on the semantic categories. The method further includes restoring, based on the aggregated contexts, textures in the target region without affecting the delicate shape of the object. In addition, the method includes displaying a refined image including the restored textures in the target region and the object.

    Generating annotated natural language phrases

    公开(公告)号:US11036926B2

    公开(公告)日:2021-06-15

    申请号:US16236886

    申请日:2018-12-31

    Abstract: A system receives a phrase that includes at least one tagged object and generates instantiated phrases by instantiations of each tagged object in the phrase. The system generates lists of natural language phrases by corresponding paraphrases of each of the instantiated phrases. The system generates ordered lists of natural language phrases by ordering natural language phrases in each list of natural language phrases based on occurrences of each natural language phrase. The system generates annotated natural language phrases by using each tagged object in the phrase to annotate the ordered lists of natural language phrases or an enhanced set of natural language phrases that is based on the ordered lists of natural language phrases.

    ON-DEVICE LIGHTWEIGHT NATURAL LANGUAGE UNDERSTANDING (NLU) CONTINUAL LEARNING

    公开(公告)号:US20210004532A1

    公开(公告)日:2021-01-07

    申请号:US16946746

    申请日:2020-07-02

    Abstract: A method includes obtaining, using at least one processor of an electronic device, a base model trained to perform natural language understanding. The method also includes generating, using the at least one processor, a first model expansion based on knowledge from the base model. The method further includes training, using the at least one processor, the first model expansion based on first utterances without modifying parameters of the base model. The method also includes receiving, using the at least one processor, an additional utterance from a user. In addition, the method includes determining, using the at least one processor, a meaning of the additional utterance using the base model and the first model expansion.

Patent Agency Ranking