公开(公告)号：US20240194190A1

公开(公告)日：2024-06-13

申请号：US18581286

申请日：2024-02-19

Applicant: GOOGLE LLC

Inventor： Yuan Yuan ,  Bibo Xu ,  Tianyu Wang ,  Anurag Jain

IPC: G10L15/08 ,  G06F40/279 ,  G06N20/00 ,  G06V40/19

CPC classification number: G10L15/08 ,  G06F40/279 ,  G06N20/00 ,  G06V40/19 ,  G10L2015/088

Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are useable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands. Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.

公开(公告)号：US20240055003A1

公开(公告)日：2024-02-15

申请号：US18383314

申请日：2023-10-24

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Yuan Yuan

IPC: G10L15/24 ,  G06N3/04 ,  G06F3/01 ,  G10L15/16 ,  G06F18/25

CPC classification number: G10L15/24 ,  G06N3/04 ,  G06F3/013 ,  G10L15/16 ,  G06F18/251 ,  G10L2015/228

Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are useable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands. Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.

公开(公告)号：US20230230587A1

公开(公告)日：2023-07-20

申请号：US17579110

申请日：2022-01-19

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Gabriel Leblanc ,  Qiong Huang ,  Alexey Galata ,  Tzu-Chan Chuang ,  William A. Truong ,  Yixing Cai ,  Yuan Yuan

IPC: G10L15/22 ,  G06V40/10 ,  G10L15/24 ,  G10L15/08 ,  G10L25/78

CPC classification number: G10L15/22 ,  G06V40/103 ,  G10L15/24 ,  G10L15/08 ,  G10L25/78 ,  G10L2015/088 ,  G10L2015/227

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set. A parameter set is utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant

公开(公告)号：US20210335342A1

公开(公告)日：2021-10-28

申请号：US16973384

申请日：2019-12-11

Applicant: Google LLC

Inventor： Yuan Yuan ,  Bibo Xu ,  Tianyu Wang ,  Anurag Jain

IPC: G10L15/08 ,  G06F40/279 ,  G06N20/00 ,  G06K9/00

Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are useable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.

公开(公告)号：US20210089125A1

公开(公告)日：2021-03-25

申请号：US17110716

申请日：2020-12-03

Applicant: Google LLC

Inventor： Yuan Yuan ,  Kenneth Mixter ,  Tuan Nguyen

IPC: G06F3/01 ,  G10L15/22

Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.

公开(公告)号：US10854050B2

公开(公告)日：2020-12-01

申请号：US16460648

申请日：2019-07-02

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Yuan Yuan

IPC: G08B21/00 ,  G08B5/36 ,  G06F3/16 ,  H04L12/28 ,  G08B3/10 ,  G09G3/14 ,  G10L15/22

Abstract: A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

公开(公告)号：US12217740B2

公开(公告)日：2025-02-04

申请号：US18581286

申请日：2024-02-19

Applicant: GOOGLE LLC

Inventor： Yuan Yuan ,  Bibo Xu ,  Tianyu Wang ,  Anurag Jain

IPC: G10L15/08 ,  G06F40/279 ,  G06N20/00 ,  G06V40/19

Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are useable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands. Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.

公开(公告)号：US11948556B2

公开(公告)日：2024-04-02

申请号：US16973384

申请日：2019-12-11

Applicant: Google LLC

Inventor： Yuan Yuan ,  Bibo Xu ,  Tianyu Wang ,  Anurag Jain

IPC: G10L15/08 ,  G06F40/279 ,  G06N20/00 ,  G06V40/19

CPC classification number: G10L15/08 ,  G06F40/279 ,  G06N20/00 ,  G06V40/19 ,  G10L2015/088

Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are useable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.

公开(公告)号：US20230055223A1

公开(公告)日：2023-02-23

申请号：US17973620

申请日：2022-10-26

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Yuan Yuan

IPC: G08B5/36 ,  G06F3/16 ,  H04L12/28 ,  G08B3/10 ,  G09G3/14 ,  G10L15/22

Abstract: A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

公开(公告)号：US11493992B2

公开(公告)日：2022-11-08

申请号：US17110716

申请日：2020-12-03

Applicant: Google LLC

Inventor： Yuan Yuan ,  Kenneth Mixter ,  Tuan Nguyen

IPC: G06F3/16 ,  G10L15/22 ,  G06F3/01

Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.