公开(公告)号：US20240129567A1

公开(公告)日：2024-04-18

申请号：US18397357

申请日：2023-12-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jiyeon HONG ,  Hyeonmok Ko ,  Sungja Choi ,  Changho Paeon

IPC: H04N21/258 ,  H04N21/236 ,  H04N21/24 ,  H04N21/262

CPC classification number: H04N21/25891 ,  H04N21/236 ,  H04N21/24 ,  H04N21/262

Abstract: A method, performed by a hub device, of storing a voice assistant model for controlling a device includes receiving information about a first device connected to the hub device, requesting a voice assistant server to update a device determination model stored in the hub device; receiving the updated device determination model from the voice assistant server and storing the received updated device determination model; requesting, from the voice assistant server, information about a function determination model corresponding to the first device; receiving the information about the function determination model corresponding to the first device from the voice assistant server, and determining whether to store the function determination model in the hub device based on the received information; and based on the function determination model being determined to be stored in the hub device, storing, in the hub device, the function determination model corresponding to the first device.

公开(公告)号：US20230259545A1

公开(公告)日：2023-08-17

申请号：US18140202

申请日：2023-04-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Hyungtak CHOI ,  Hyeonmok Ko ,  Munjo Kim ,  Seonghan Ryu ,  Sejin Kwak ,  Lohith Ravuru ,  Ikhee Shin ,  Haehun Yang

IPC: G06F16/34 ,  G06V30/148 ,  G06F3/0485 ,  G06F16/332

CPC classification number: G06F16/345 ,  G06F3/0485 ,  G06F16/3329 ,  G06V30/153

Abstract: An electronic device and a method for controlling thereof are provided. The electronic device includes a display, a memory storing at least one instruction, and a processor, wherein the processor is configured to, by executing the at least one instruction, extract a plurality of texts displayed on a chat window of a message application and collect the texts, input the plurality of collected texts into a trained first neural network model and align the plurality of texts in order, input the plurality of texts aligned in order into a trained second neural network model and identify whether additional information for acquiring event information from the plurality of texts is necessary, and acquire event information from the plurality of texts based on the identification result.

公开(公告)号：US11705110B2

公开(公告)日：2023-07-18

申请号：US17104601

申请日：2020-11-25

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kyenghun Lee ,  Hyeonmok Ko ,  Kunal Sharma ,  Raghavendra Hanumantasetty Ramasetty ,  Jinyeol Kim ,  Kooktae Choi

IPC: G10L15/22 ,  G10L15/06 ,  G10L15/30

CPC classification number: G10L15/063 ,  G10L15/22 ,  G10L15/30 ,  G10L2015/223

Abstract: An electronic device and a method for controlling thereof are provided. The electronic device includes a communicator comprising circuitry, a microphone, at least one memory configured to store at least one instruction and dialogue history information, and a processor configured to execute the at least one instruction, and the processor, by executing the at least one instruction, is further configured to determine whether to transmit, to a server storing a first dialogue system, a user speech that is input through the microphone, based on determining that the user speech is transmitted to the server, control the communicator to transmit the user speech and at least a part of the stored dialogue history information to the server, receive, from the server, dialogue history information associated with the user speech, through the communicator, and control the received dialogue history information to be stored in the memory.

公开(公告)号：US11532305B2

公开(公告)日：2022-12-20

申请号：US16913310

申请日：2020-06-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Eunji Lee ,  Hyeonmok Ko ,  Kyenghun Lee ,  Saebom Jang ,  Pureum Jung ,  Sungja Choi ,  Changho Paeon ,  Jiyeon Hong ,  Inchul Hwang

IPC: G10L15/00 ,  G10L15/22 ,  G10L15/18 ,  G10L15/183 ,  G10L15/30

Abstract: An electronic apparatus is provided. The electronic apparatus includes: a memory configured to store at least one instruction; and a processor configured to execute the at least one instruction to: obtain usage information on an application installed in the electronic apparatus, obtain a natural language understanding model, among a plurality of natural language understanding models, corresponding to the application based on the usage information, perform natural language understanding of a user voice input related to the application based on the natural language understanding model corresponding to the application, and perform an operation of the application based on the preformed natural language understanding.

公开(公告)号：US11423895B2

公开(公告)日：2022-08-23

申请号：US16758570

申请日：2019-09-25

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Inchul Hwang ,  Hyeonmok Ko ,  Munjo Kim ,  Hyungtak Choi

IPC: G10L15/22 ,  G06F3/14 ,  G06F3/16 ,  G06N3/08 ,  G10L15/06 ,  G10L25/63 ,  G10L15/16

Abstract: Provided are a method and device for providing an event-emotion-based interactive interface by using an artificial intelligence (AI) system. The method includes identifying an emotional state of a user for at least one event by analyzing a response to a query, learning emotion information of the user for the at least one event, based on the emotional state of the user, determining an interaction type for the at least one event, based on the emotion information of the user, and providing notification information for the at least one event, based on the interaction type.

公开(公告)号：US20210056967A1

公开(公告)日：2021-02-25

申请号：US16897427

申请日：2020-06-10

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Saebom Jang ,  Hyeonmok Ko ,  Kyenghun Lee ,  Kunal Sharma ,  Raghavendra Hanumantasetty Ramasetty

IPC: G10L15/22 ,  G10L15/34 ,  G10L15/28

Abstract: Disclosed are an electronic device capable of efficiently performing speech recognition and natural language understanding and a method for controlling thereof. The electronic device includes: a microphone; a non-volatile memory configured to store virtual assistant model data comprising data that is classified according to a plurality of domains and data that is commonly used for the plurality of domains; a volatile memory; and a processor configured to: based on receiving, through the microphone, a trigger input to perform speech recognition for a user speech, initiate loading the virtual assistant model data from the non-volatile memory into the volatile memory, load, into the volatile memory, first data from among the data classified according to the plurality of domains and, while loading the first data into the volatile memory, load at least a part of the data commonly used for the plurality of domains into the volatile memory.

公开(公告)号：US12080289B2

公开(公告)日：2024-09-03

申请号：US17486252

申请日：2021-09-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Hyeonmok Ko ,  Dayoung Kwon ,  Jonggu Kim ,  Seoha Song ,  Kyenghun Lee ,  Hojung Lee ,  Saebom Jang ,  Pureum Jung ,  Changho Paeon ,  Jiyeon Hong

IPC: G10L15/22 ,  G06N3/045 ,  G10L15/06 ,  G10L15/26 ,  G10L15/30

CPC classification number: G10L15/22 ,  G06N3/045 ,  G10L15/063 ,  G10L15/26 ,  G10L15/30 ,  G10L2015/223

Abstract: Disclosed is an electronic apparatus. The electronic apparatus includes: a communication interface, a memory, and a processor connected to the memory and the communication interface, the processor configured to control the electronic apparatus to, based on receiving a speech related to a function of the electronic apparatus, obtain text information corresponding to the received speech, control the communication interface to transmit the obtained text information to a server including a first neural network model corresponding to the function, execute the function based on response information received from the server, and based on identifying that an update period of the first neural network model is greater than or equal to a first threshold period based on the information related to the function of the electronic apparatus, the electronic apparatus may receive the information about the first neural network model from the server and store the information in the memory.

公开(公告)号：US11930230B2

公开(公告)日：2024-03-12

申请号：US17085565

申请日：2020-10-30

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jiyeon Hong ,  Hyeonmok Ko ,  Sungja Choi ,  Changho Paeon

IPC: H04N5/445 ,  H04N21/236 ,  H04N21/24 ,  H04N21/258 ,  H04N21/262

CPC classification number: H04N21/25891 ,  H04N21/236 ,  H04N21/24 ,  H04N21/262

Abstract: A method, performed by a hub device, of storing a voice assistant model for controlling a device includes receiving information about a first device connected to the hub device, requesting a voice assistant server to update a device determination model stored in the hub device; receiving the updated device determination model from the voice assistant server and storing the received updated device determination model; requesting, from the voice assistant server, information about a function determination model corresponding to the first device; receiving the information about the function determination model corresponding to the first device from the voice assistant server, and determining whether to store the function determination model in the hub device based on the received information; and based on the function determination model being determined to be stored in the hub device, storing, in the hub device, the function determination model corresponding to the first device.

公开(公告)号：US11709655B2

公开(公告)日：2023-07-25

申请号：US17880169

申请日：2022-08-03

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hyungtak Choi ,  Hyeonmok Ko ,  Jihie Kim ,  Hongchul Kim ,  Inchul Hwang

IPC: G10L17/22 ,  G06F3/16 ,  G06F3/01 ,  G06F3/00 ,  G10L17/18 ,  G06V40/16 ,  G06F18/00

CPC classification number: G06F3/167 ,  G06F3/00 ,  G06F3/005 ,  G06F3/01 ,  G06F3/011 ,  G06F3/16 ,  G06F18/00 ,  G06V40/171 ,  G10L17/18 ,  G10L17/22

Abstract: Disclosed is an electronic device. The electronic device comprises: a microphone comprising circuitry; a speaker comprising circuitry; and a processor electrically connected to the microphone and speaker, wherein the processor, when a first user's voice is input through the microphone, identifies a user who uttered the first user's voice and provides a first response sound, which is obtained by inputting the first user's voice to an artificial intelligence model learned through an artificial intelligence algorithm, through the speaker, and when a second user's voice is input through the microphone, identifies a user who uttered the second user's voice, and if the user who uttered the first user's voice is the same as the user who uttered the second user's voice, provides a second response sound, which is obtained by inputting the second user's voice and utterance history information to the artificial intelligence model, through the speaker. In particular, at least some of the methods of providing a response sound to a user's voice may use an artificial intelligence model learned in accordance with at least one of a machine learning, neural network, or deep learning algorithm.

公开(公告)号：US11443749B2

公开(公告)日：2022-09-13

申请号：US16967910

申请日：2019-01-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hyungtak Choi ,  Hyeonmok Ko ,  Jihie Kim ,  Hongchul Kim ,  Inchul Hwang

IPC: G10L17/22 ,  G06F3/16 ,  G06F3/01 ,  G06F3/00 ,  G06K9/00 ,  G10L17/18 ,  G06V40/16

Abstract: Disclosed is an electronic device. The electronic device comprises: a microphone comprising circuitry; a speaker comprising circuitry; and a processor electrically connected to the microphone and speaker, wherein the processor, when a first user's voice is input through the microphone, identifies a user who uttered the first user's voice and provides a first response sound, which is obtained by inputting the first user's voice to an artificial intelligence model learned through an artificial intelligence algorithm, through the speaker, and when a second user's voice is input through the microphone, identifies a user who uttered the second user's voice, and if the user who uttered the first user's voice is the same as the user who uttered the second user's voice, provides a second response sound, which is obtained by inputting the second user's voice and utterance history information to the artificial intelligence model, through the speaker. In particular, at least some of the methods of providing a response sound to a user's voice may use an artificial intelligence model learned in accordance with at least one of a machine learning, neural network, or deep learning algorithm.