公开(公告)号：US10890969B2

公开(公告)日：2021-01-12

申请号：US16606529

申请日：2018-05-04

Applicant: Google LLC

Inventor： Yuan Yuan ,  Kenneth Mixter ,  Tuan Nguyen

IPC: G06F3/01 ,  G06F3/13 ,  G06F3/16 ,  G10L15/22

Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.

公开(公告)号：US20200167597A1

公开(公告)日：2020-05-28

申请号：US16618532

申请日：2018-05-04

Applicant: Google LLC

Inventor： Tuan Nguyen ,  Kenneth Mixter ,  Yuan Yuan

IPC: G06K9/62 ,  G06K9/00 ,  G06F9/451 ,  G06T7/73 ,  G06F3/16 ,  G06F3/01 ,  G06F3/03

Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.

公开(公告)号：US20240347062A1

公开(公告)日：2024-10-17

申请号：US18751972

申请日：2024-06-24

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Gabriel Leblanc ,  Qiong Huang ,  Alexey Galata ,  Tzu-Chan Chuang ,  William A. Truong ,  Yixing Cai ,  Yuan Yuan

IPC: G10L15/22 ,  G06F3/01 ,  G06F3/16 ,  G06V40/10 ,  G10L15/08 ,  G10L15/24 ,  G10L17/22 ,  G10L25/78

CPC classification number: G10L15/22 ,  G06V40/103 ,  G10L15/08 ,  G10L15/24 ,  G10L25/78 ,  G06F3/013 ,  G06F3/167 ,  G10L2015/088 ,  G10L2015/227 ,  G10L17/22

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set. A parameter set is utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant

公开(公告)号：US12020704B2

公开(公告)日：2024-06-25

申请号：US17579110

申请日：2022-01-19

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Gabriel Leblanc ,  Qiong Huang ,  Alexey Galata ,  Tzu-Chan Chuang ,  William A. Truong ,  Yixing Cai ,  Yuan Yuan

IPC: G06F3/16 ,  G06F3/01 ,  G06V40/10 ,  G10L15/08 ,  G10L15/22 ,  G10L15/24 ,  G10L25/78 ,  G10L17/22

CPC classification number: G10L15/22 ,  G06V40/103 ,  G10L15/08 ,  G10L15/24 ,  G10L25/78 ,  G06F3/013 ,  G06F3/167 ,  G10L2015/088 ,  G10L2015/227 ,  G10L17/22

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set. A parameter set is utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant.

公开(公告)号：US11972678B2

公开(公告)日：2024-04-30

申请号：US17973620

申请日：2022-10-26

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Yuan Yuan

IPC: G08B21/00 ,  G06F3/16 ,  G08B3/10 ,  G08B5/36 ,  G09G3/14 ,  G10L15/22 ,  H04L12/28

CPC classification number: G08B5/36 ,  G06F3/167 ,  G08B3/10 ,  G09G3/14 ,  G10L15/22 ,  H04L12/282 ,  H04L12/2825 ,  G10L2015/225

Abstract: A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

公开(公告)号：US11521469B2

公开(公告)日：2022-12-06

申请号：US17105081

申请日：2020-11-25

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Yuan Yuan

IPC: G08B21/00 ,  G08B5/36 ,  G06F3/16 ,  H04L12/28 ,  G08B3/10 ,  G09G3/14 ,  G10L15/22

Abstract: A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

公开(公告)号：US11237630B2

公开(公告)日：2022-02-01

申请号：US17110716

申请日：2020-12-03

Applicant: Google LLC

Inventor： Yuan Yuan ,  Kenneth Mixter ,  Tuan Nguyen

IPC: G06F3/16 ,  G10L15/22 ,  G06F3/01

Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.

公开(公告)号：US20210117720A1

公开(公告)日：2021-04-22

申请号：US17135272

申请日：2020-12-28

Applicant: Google LLC

Inventor： Tuan Nguyen ,  Kenneth Mixter ,  Yuan Yuan

IPC: G06K9/62 ,  G06T7/73 ,  G06F9/451 ,  G06F3/01 ,  G06F3/03 ,  G06F3/16 ,  G06K9/00 ,  G06F3/0482

Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.

公开(公告)号：US20210082258A1

公开(公告)日：2021-03-18

申请号：US17105081

申请日：2020-11-25

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Yuan Yuan

IPC: G08B5/36 ,  G06F3/16 ,  H04L12/28 ,  G08B3/10 ,  G09G3/14 ,  G10L15/22

Abstract: A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

公开(公告)号：US20200342223A1

公开(公告)日：2020-10-29

申请号：US16606030

申请日：2018-05-04

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Yuan Yuan ,  Tuan Nguyen

IPC: G06K9/00 ,  G06F3/01 ,  G06F3/16

Abstract: Adapting an automated assistant based on detecting: movement of a mouth of a user; and/or that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. The detecting of the mouth movement and/or the directed gaze can be based on processing of vision data from one or more vision components associated with the assistant device, such as a camera incorporated in the assistant device. The mouth movement that is detected can be movement that is indicative of a user (to whom the mouth belongs) speaking.