公开(公告)号：US20210004532A1

公开(公告)日：2021-01-07

申请号：US16946746

申请日：2020-07-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yilin Shen ,  Xiangyu Zeng ,  Hongxia Jin

IPC: G06F40/279

Abstract: A method includes obtaining, using at least one processor of an electronic device, a base model trained to perform natural language understanding. The method also includes generating, using the at least one processor, a first model expansion based on knowledge from the base model. The method further includes training, using the at least one processor, the first model expansion based on first utterances without modifying parameters of the base model. The method also includes receiving, using the at least one processor, an additional utterance from a user. In addition, the method includes determining, using the at least one processor, a meaning of the additional utterance using the base model and the first model expansion.

公开(公告)号：US11423225B2

公开(公告)日：2022-08-23

申请号：US16946746

申请日：2020-07-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yilin Shen ,  Xiangyu Zeng ,  Hongxia Jin

IPC: G10L15/16 ,  G06F40/30 ,  G06N3/04 ,  G06F40/279

Abstract: A method includes obtaining, using at least one processor of an electronic device, a base model trained to perform natural language understanding. The method also includes generating, using the at least one processor, a first model expansion based on knowledge from the base model. The method further includes training, using the at least one processor, the first model expansion based on first utterances without modifying parameters of the base model. The method also includes receiving, using the at least one processor, an additional utterance from a user. In addition, the method includes determining, using the at least one processor, a meaning of the additional utterance using the base model and the first model expansion.

公开(公告)号：US11094317B2

公开(公告)日：2021-08-17

申请号：US16404012

申请日：2019-05-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yilin Shen ,  Xiangyu Zeng ,  Yu Wang ,  Hongxia Jin

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/06 ,  G10L15/183 ,  G10L15/16

Abstract: An electronic device for training a machine learning model includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to train a classification layer of the model. To train the classification layer, the at least one processor is configured to receive, by the classification layer, one or more language contexts from an utterance encoder layer and to classify, by the classification layer, at least one portion of an utterance into an information type among a plurality of information types. The at least one processor may be further configured to jointly train a slot filling layer and an intent detection layer of the model.

公开(公告)号：US20200043480A1

公开(公告)日：2020-02-06

申请号：US16404012

申请日：2019-05-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yilin Shen ,  Xiangyu Zeng ,  Yu Wang ,  Hongxia Jin

IPC: G10L15/18 ,  G10L15/06 ,  G10L15/183 ,  G10L15/22

Abstract: An electronic device for training a machine learning model includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to train a classification layer of the model. To train the classification layer, the at least one processor is configured to receive, by the classification layer, one or more language contexts from an utterance encoder layer and to classify, by the classification layer, at least one portion of an utterance into an information type among a plurality of information types. The at least one processor may be further configured to jointly train a slot filling layer and an intent detection layer of the model.