-
公开(公告)号:US20250045526A1
公开(公告)日:2025-02-06
申请号:US18823169
申请日:2024-09-03
Applicant: Google LLC
Inventor: Dana Movshovitz-Attias , John Patrick McGregor, Jr. , Gaurav Nemade , Sujith Ravi , Jeongwoo Ko , Dora Demszky
IPC: G06F40/289 , G06F40/30 , G06N20/00
Abstract: The technology relates to methods for detecting and classifying emotions in textual communication, and using this information to suggest graphical indicia such as emoji, stickers or GIFs to a user. Two main types of models are fully supervised models and few-shot models. In addition to fully supervised and few-shot models, other types of models focusing on the back-end (server) side or client (on-device) side may also be employed. Server-side models are larger-scale models that can enable higher degrees of accuracy, such as for use cases where models can be hosted on cloud servers where computational and storage resources are relatively abundant. On-device models are smaller-scale models, which enable use on resource-constrained devices such as mobile phones, smart watches or other wearables (e.g., head mounted displays), in-home devices, embedded devices, etc.
-
公开(公告)号:US10416846B2
公开(公告)日:2019-09-17
申请号:US15350040
申请日:2016-11-12
Applicant: Google LLC
Inventor: Ryan Cassidy , Utkarsh Srivastava , Anton Volkov , John Patrick McGregor, Jr.
IPC: G06F3/0482 , G06F17/27 , H04L12/58 , G06F3/0488 , G06Q50/00 , G06F3/0481 , G06F3/0484 , G06F3/0489 , G06F3/01 , G06F3/023
Abstract: Methods, apparatus, and computer readable media related to determining graphical element(s) (e.g., emojis, GIFs, stickers) for inclusion in an electronic communication being formulated by a user via a computing device of the user, and providing the graphical element(s) for inclusion in the electronic communication. For example, the graphical element(s) may be provided for presentation to the user via a display of the computing device of the user and, in response to user interface input directed to one of the graphical element(s), that graphical element may be incorporated in the electronic communication. In various implementations, the electronic communication is a communication to be submitted as part of a dialog that involves the user and one or more additional users.
-
公开(公告)号:US10862836B2
公开(公告)日:2020-12-08
申请号:US16560815
申请日:2019-09-04
Applicant: Google LLC
Inventor: John Patrick McGregor, Jr. , Ryan Cassidy , Ariel Fuxman , Vivek Ramavajjala , Sujith Ravi , Sergey Nazarov , Amit Fulay
IPC: H04L12/58 , G06K9/72 , G06K9/62 , G06F3/0484
Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.
-
公开(公告)号:US10146768B2
公开(公告)日:2018-12-04
申请号:US15415506
申请日:2017-01-25
Applicant: Google LLC
Inventor: Ariel Fuxman , Vivek Ramavajjala , Ning Ye , John Patrick McGregor, Jr.
Abstract: Implementations relate to automatic response suggestions to images included in received messages. In some implementations, a computer-implemented method includes detecting an image posted within a first message by a first user, and programmatically analyzing the image to determine a feature vector representative of the image. The method programmatically generates one or more suggested responses to the first message based on the feature vector, each suggested response being a conversational reply to the first message. Generating the suggested responses includes determining probabilities associated with word sequences for the feature vector using a model trained with previous responses to previous images, and selecting one or more of the word sequences based on the associated probabilities. The suggested responses are determined based on the selected word sequences. The method causes the suggested responses to be rendered in the messaging application as one or more suggestions to a second user.
-
公开(公告)号:US12112134B2
公开(公告)日:2024-10-08
申请号:US17582206
申请日:2022-01-24
Applicant: Google LLC
Inventor: Dana Movshovitz-Attias , John Patrick McGregor, Jr. , Gaurav Nemade , Sujith Ravi , Jeongwoo Ko , Dora Demszky
IPC: G06F40/289 , G06F40/30 , G06N20/00
CPC classification number: G06F40/289 , G06F40/30 , G06N20/00
Abstract: The technology relates to methods for detecting and classifying emotions in textual communication, and using this information to suggest graphical indicia such as emoji, stickers or GIFs to a user. Two main types of models are fully supervised models and few-shot models. In addition to fully supervised and few-shot models, other types of models focusing on the back-end (server) side or client (on-device) side may also be employed. Server-side models are larger-scale models that can enable higher degrees of accuracy, such as for use cases where models can be hosted on cloud servers where computational and storage resources are relatively abundant. On-device models are smaller-scale models, which enable use on resource-constrained devices such as mobile phones, smart watches or other wearables (e.g., head mounted displays), in-home devices, embedded devices, etc.
-
公开(公告)号:US10412030B2
公开(公告)日:2019-09-10
申请号:US16003661
申请日:2018-06-08
Applicant: Google LLC
Inventor: John Patrick McGregor, Jr. , Ryan Cassidy , Ariel Fuxman , Vivek Ramavajjala , Sujith Ravi , Sergey Nazarov , Amit Fulay
IPC: H04L12/58 , G06K9/72 , G06K9/62 , G06F3/0484
Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.
-
公开(公告)号:US10015124B2
公开(公告)日:2018-07-03
申请号:US15709418
申请日:2017-09-19
Applicant: Google LLC
Inventor: John Patrick McGregor, Jr. , Ryan Cassidy , Ariel Fuxman , Vivek Ramavajjala , Sujith Ravi , Sergey Nazarov , Amit Fulay
IPC: H04L12/58 , G06K9/72 , G06K9/62 , G06F3/0484
CPC classification number: H04L51/10 , G06F3/04842 , G06K9/6202 , G06K9/6215 , G06K9/726 , H04L51/02 , H04L51/32
Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.
-
-
-
-
-
-