公开(公告)号：US11721090B2

公开(公告)日：2023-08-08

申请号：US16041479

申请日：2018-07-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yue Deng ,  Yilin Shen ,  Hongxia Jin

IPC: G06V10/82 ,  G06N3/08 ,  G06V20/40 ,  H04N21/25 ,  H04N21/466 ,  H04N21/45 ,  G06F18/241 ,  G06F18/245 ,  G06F18/214 ,  G06N3/045 ,  G06N3/047 ,  G06V10/764 ,  G06V10/774 ,  G06F16/435 ,  G06Q30/0251

CPC classification number: G06V10/82 ,  G06F16/435 ,  G06F18/2155 ,  G06F18/241 ,  G06F18/245 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06Q30/0269 ,  G06V10/764 ,  G06V10/7753 ,  G06V20/46 ,  H04N21/251 ,  H04N21/45 ,  H04N21/466 ,  H04N21/4666 ,  H04N21/4668

Abstract: A recommendation method includes retrieving content consumption data including content consumed and content not consumed. Based on the content consumption data, identifying a first piece of content not consumed. A first feature of the first piece of content related to negative consumption of the first piece of content is determined. A first system is used to revise the first feature to a second feature. A second piece of content including the second feature is provided to an electronic device. The second piece of content is a revised instance of the first piece of content.

公开(公告)号：US20230245435A1

公开(公告)日：2023-08-03

申请号：US17589535

申请日：2022-01-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Changsheng Zhao ,  Burak Uzkent ,  Yilin Shen ,  Hongxia Jin

IPC: G06V10/80 ,  G06V10/778 ,  G06V10/774 ,  G06F40/279

CPC classification number: G06V10/811 ,  G06V10/778 ,  G06V10/774 ,  G06F40/279

Abstract: A method includes obtaining a batch of training data including multiple paired image-text pairs and multiple unpaired image-text pairs, where each paired image-text pair and each unpaired image-text pair includes an image and a text. The method also includes training a machine learning model using the training data based on an optimization of a combination of losses. The losses include, for each paired image-text pair, (i) a first multi-modal representation loss based on the paired image-text pair and (ii) a second multi-modal representation loss based on two or more unpaired image-text pairs, selected from among the multiple unpaired image-text pairs, wherein each of the two or more unpaired image-text pairs includes either the image or the text of the paired image-text pair.

公开(公告)号：US20230061906A1

公开(公告)日：2023-03-02

申请号：US17817778

申请日：2022-08-05

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Manas Gaur ,  Dalkandura Arachchige Kalpa Shashika Silva Gunaratna ,  Vijay Srinivasan ,  Hongxia Jin

IPC: G06F40/30 ,  G06F16/332 ,  G06F16/242 ,  G06F40/211

Abstract: Computer-based generation of information-gathering questions in response to a user query can include parsing the user query using natural language processing and extracting from the user query one or more phrases corresponding to a predetermined category. A knowledge database can be accessed, and entities semantically related to each phrase can be extracted therefrom. A query sub-graph representing a relationship between each of the one or more phrases and the entities extracted from the knowledge database can be generated. An expanded user query can be generated by traversing the query sub-graph. Passages semantically related to the expanded user query can be retrieved from one or more passages databases and ranked. A neural question generator can generate a set of information-gathering questions based on the expanded user query and a group of select passages selected from the plurality of passages in accordance with each selected passage's ranking.

公开(公告)号：US11526967B2

公开(公告)日：2022-12-13

申请号：US16950835

申请日：2020-11-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Wenbo Li ,  Hongxia Jin

IPC: G06T5/00 ,  G06T5/50

Abstract: An inpainting method includes retrieving image information at an electronic device, where the image information identifies an area within an image. The method also includes retrieving, using the electronic device, semantic information including a plurality of semantic classes and a semantic class distribution for each semantic class of the plurality of semantic classes. The method further includes generating semantic codes associated with different portions of the image based on the image information and the semantic information. In addition, the method includes constructing the area within the image by generating image content based on the semantic information.

公开(公告)号：US11468881B2

公开(公告)日：2022-10-11

申请号：US16370497

申请日：2019-03-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Sandeep Nama ,  Hongxia Jin

IPC: G10L15/06 ,  G06F16/901 ,  G10L15/30

Abstract: A method includes receiving, at an electronic device, a command directed to a first application operated by the electronic device. Features presented by the first application in response to interactions with the first application are captured at the electronic device. Data communicated with the first application via the interactions with the first application are captured at the electronic device. A task is learned based on the captured features and communicated data.

公开(公告)号：US11455471B2

公开(公告)日：2022-09-27

申请号：US16947258

申请日：2020-07-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yilin Shen ,  Hongxia Jin

IPC: G06F40/30 ,  G06N3/08 ,  G06F40/279

Abstract: A method includes obtaining, using at least one processor of an electronic device, a base natural language understanding (NLU) model that includes a word embedding layer, where the word embedding layer is associated with at least one training utterance. The method also includes calculating, using the at least one processor, a regularization loss value for use in a determination of an intent detection loss, where the regularization loss value reveals an effect of word embeddings on intent determination of the training utterance. The method further includes retraining, using the at least one processor, the word embedding layer of the base NLU model using the intent detection loss to obtain a retrained NLU model.

公开(公告)号：US20220301117A1

公开(公告)日：2022-09-22

申请号：US17504221

申请日：2021-10-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Wenbo Li ,  Hongxia Jin

IPC: G06T5/00 ,  G06K9/20 ,  G06K9/72 ,  G06K9/62

Abstract: An inpainting method includes obtaining image information at an electronic device, where the image information identifies an area corresponding to a removed object within an image. The method also includes reconstructing the area corresponding to the removed object by (i) applying a semantic mask and a surface normal map to identify and rank neighboring contexts of the area and (ii) sampling, using an attention mechanism, the ranked contexts to generate pixel information for the area. The method further includes rendering the image with the reconstructed area.

公开(公告)号：US11275896B2

公开(公告)日：2022-03-15

申请号：US15986633

申请日：2018-05-22

Applicant: Samsung Electronics Co., Ltd.

Inventor： Avik Ray ,  Yilin Shen ,  Hongxia Jin

IPC: G10L15/22 ,  G06F40/30 ,  G06F9/451 ,  G06N5/02 ,  G06F40/205 ,  G06F40/253 ,  G10L15/07 ,  G10L15/06

Abstract: A method includes determining, by an electronic device, a skill from a first natural language (NL) input. Upon successful determination of the skill, the first NL input is transmitted to a custom skill parser for determination of a skill intent. The custom skill parser is trained based on data including at least a custom training data set. Upon unsuccessful determination of the skill, the first NL input is transmitted to a generic parser for determination of a general intent of the first NL input.

公开(公告)号：US20210407090A1

公开(公告)日：2021-12-30

申请号：US16946504

申请日：2020-06-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Dawei Li ,  Wenbo Li ,  Hongxia Jin

IPC: G06T7/10 ,  G06N3/04 ,  G06K9/62

Abstract: A method includes training, using at least one processor, a specialized teacher model to perform visual object instance segmentation in order to segment and classify objects in first training images. The first training images contain foreground objects without backgrounds. The method also includes training, using the at least one processor, a student model to perform visual object instance segmentation in order to segment and classify objects in second training images. The second training images contain the foreground objects and the backgrounds. Training the student model includes using selected outputs of the specialized teacher model. The method further includes deploying the trained student model to perform visual object instance segmentation in an external device.

公开(公告)号：US20210383272A1

公开(公告)日：2021-12-09

申请号：US17166908

申请日：2021-02-03

Applicant: Samsung Electronics Co., Ltd.

Inventor： Ting Hua ,  Yilin Shen ,  Changsheng Zhao ,  Hongxia Jin

IPC: G06N20/00 ,  G06K9/62

Abstract: A continual learning method includes obtaining an input data including a trained model, continual learning (CL) Information, and training data by an electronic device. The method also includes re-training, using the electronic device, the model for a task based on the training data. The method also includes updating, using the electronic device, the CL Information based on the model and the training data. The method further includes selecting a first set of exemplars from the training data based on data associated with the CL Information. The CL Information includes a first group of variables associated with the model and a second group of variables associated with the model that changes to the first group of variables have stronger impact to the model's performance of the task than changes to the second group of variables.