公开(公告)号：US20230316814A1

公开(公告)日：2023-10-05

申请号：US18204785

申请日：2023-06-01

Applicant: GOOGLE LLC

Inventor： Diego Melendo Casado ,  Tuan Nguyen ,  Jaclyn Konzelmann ,  Gustavo Moura ,  Tanya Kraljic

IPC: G06V40/50 ,  G10L17/04 ,  G10L17/00 ,  G06V40/70 ,  G06V40/16

CPC classification number: G06V40/50 ,  G10L17/04 ,  G10L17/00 ,  G06V40/70 ,  G06V40/161

Abstract: Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.

公开(公告)号：US20230230587A1

公开(公告)日：2023-07-20

申请号：US17579110

申请日：2022-01-19

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Gabriel Leblanc ,  Qiong Huang ,  Alexey Galata ,  Tzu-Chan Chuang ,  William A. Truong ,  Yixing Cai ,  Yuan Yuan

IPC: G10L15/22 ,  G06V40/10 ,  G10L15/24 ,  G10L15/08 ,  G10L25/78

CPC classification number: G10L15/22 ,  G06V40/103 ,  G10L15/24 ,  G10L15/08 ,  G10L25/78 ,  G10L2015/088 ,  G10L2015/227

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set. A parameter set is utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant

公开(公告)号：US20220148339A1

公开(公告)日：2022-05-12

申请号：US17580334

申请日：2022-01-20

Applicant: Google LLC

Inventor： Diego Melendo Casado ,  Tuan Nguyen ,  Jaclyn Konzelmann ,  Gustavo Moura ,  Tanya Kraljic

IPC: G06V40/50 ,  G10L17/00 ,  G10L17/04 ,  G06V40/16 ,  G06V40/70

Abstract: Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.

公开(公告)号：US20210089125A1

公开(公告)日：2021-03-25

申请号：US17110716

申请日：2020-12-03

Applicant: Google LLC

Inventor： Yuan Yuan ,  Kenneth Mixter ,  Tuan Nguyen

IPC: G06F3/01 ,  G10L15/22

Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.

公开(公告)号：US20200349966A1

公开(公告)日：2020-11-05

申请号：US16622771

申请日：2019-05-02

Applicant: Google LLC

Inventor： Jaclyn Konzelmann ,  Kenneth Mixter ,  Sourish Chaudhuri ,  Tuan Nguyen ,  Hideaki Matsui ,  Caroline Pantofaru ,  Vinay Bettadapura

IPC: G10L25/78 ,  G06F3/16 ,  G06K9/00

Abstract: Hot-word free adaptation of one or more function(s) of an automated assistant. Sensor data, from one or more sensor components of an assistant device that provides an automated assistant interface (graphical and/or audible), is processed to determine occurrence and/or confidence metric(s) of various attributes of a user that is proximal to the assistant device. Whether to adapt each of one or more of the function(s) of the automated assistant is based on the occurrence and/or the confidence of one or more of the various attributes. For example, certain processing of at least some of the sensor data can be initiated, such as initiating previously dormant local processing of at least some of the sensor data and/or initiating transmission of at least some of the audio data to remote automated assistant component(s).

公开(公告)号：US20180190264A1

公开(公告)日：2018-07-05

申请号：US15841284

申请日：2017-12-13

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Daniel Colish ,  Tuan Nguyen

IPC: G10L13/04 ,  G10L15/22 ,  G10L15/26 ,  H04L29/08 ,  H04L12/58 ,  G06F3/16

Abstract: A method for proactive notifications in a voice interface device includes: receiving a first user voice request for an action with an future performance time; assigning the first user voice request to a voice assistant service for performance; subsequent to the receiving, receiving a second user voice request and in response to the second user voice request initiating a conversation with the user; and during the conversation: receiving a notification from the voice assistant service of performance of the action; triggering a first audible announcement to the user to indicate a transition from the conversation and interrupting the conversation; triggering a second audible announcement to the user to indicate performance of the action; and triggering a third audible announcement to the user to indicate a transition back to the conversation and rejoining the conversation.

公开(公告)号：US20250126323A1

公开(公告)日：2025-04-17

申请号：US18982816

申请日：2024-12-16

Applicant: GOOGLE LLC

Inventor： Jaclyn Konzelmann ,  Tuan Nguyen ,  Vinay Bettadapura ,  Andrew Gallagher ,  Utsav Prabhu ,  Caroline Pantofaru

IPC: H04N21/442 ,  G06T7/70 ,  H04N21/258 ,  H04N21/41 ,  H04W12/64

Abstract: Implementations relate to an automated assistant that provides and manages output from one or more elements of output hardware of a computing device. The automated assistant manages dynamic adjustment of access permissions to the computing device according to, for example, a detected presence of one or more users. An active-user queue can be established each time a unique user enters a viewing window of a camera of the computing device when, up to that point, no user was considered active. Multiple image frames can be captured via the camera and processed to determine whether an initial user remains in the viewing window and/or whether another user has entered the viewing window. The initial user can be considered active as long as they are exclusively detected in the viewing window. Restricted content associated with the user may be rendered by the computing device whilst the user is active.

公开(公告)号：US20240347062A1

公开(公告)日：2024-10-17

申请号：US18751972

申请日：2024-06-24

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Gabriel Leblanc ,  Qiong Huang ,  Alexey Galata ,  Tzu-Chan Chuang ,  William A. Truong ,  Yixing Cai ,  Yuan Yuan

IPC: G10L15/22 ,  G06F3/01 ,  G06F3/16 ,  G06V40/10 ,  G10L15/08 ,  G10L15/24 ,  G10L17/22 ,  G10L25/78

CPC classification number: G10L15/22 ,  G06V40/103 ,  G10L15/08 ,  G10L15/24 ,  G10L25/78 ,  G06F3/013 ,  G06F3/167 ,  G10L2015/088 ,  G10L2015/227 ,  G10L17/22

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set. A parameter set is utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant

公开(公告)号：US12056956B2

公开(公告)日：2024-08-06

申请号：US18204785

申请日：2023-06-01

Applicant: GOOGLE LLC

Inventor： Diego Melendo Casado ,  Tuan Nguyen ,  Jaclyn Konzelmann ,  Gustavo Moura ,  Tanya Kraljic

IPC: G06V40/50 ,  G06V40/16 ,  G06V40/70 ,  G10L17/00 ,  G10L17/04

CPC classification number: G06V40/50 ,  G06V40/161 ,  G06V40/70 ,  G10L17/00 ,  G10L17/04

Abstract: Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.

公开(公告)号：US12020704B2

公开(公告)日：2024-06-25

申请号：US17579110

申请日：2022-01-19

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Gabriel Leblanc ,  Qiong Huang ,  Alexey Galata ,  Tzu-Chan Chuang ,  William A. Truong ,  Yixing Cai ,  Yuan Yuan

IPC: G06F3/16 ,  G06F3/01 ,  G06V40/10 ,  G10L15/08 ,  G10L15/22 ,  G10L15/24 ,  G10L25/78 ,  G10L17/22

CPC classification number: G10L15/22 ,  G06V40/103 ,  G10L15/08 ,  G10L15/24 ,  G10L25/78 ,  G06F3/013 ,  G06F3/167 ,  G10L2015/088 ,  G10L2015/227 ,  G10L17/22

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set. A parameter set is utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant.