-
41.
公开(公告)号:US20240028108A1
公开(公告)日:2024-01-25
申请号:US18375876
申请日:2023-10-02
Applicant: GOOGLE LLC
Inventor: Tuan Nguyen , Kenneth Mixter , Yuan Yuan
CPC classification number: G06F3/011 , G06T7/74 , G06F9/453 , G06F3/013 , G06F3/017 , G06F3/0304 , G06F3/167 , G06F3/0482 , G06V40/20 , G06F18/22
Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.
-
42.
公开(公告)号:US20230396841A1
公开(公告)日:2023-12-07
申请号:US18234771
申请日:2023-08-16
Applicant: GOOGLE LLC
Inventor: Jaclyn Konzelmann , Tuan Nguyen , Vinay Bettadapura , Andrew Gallagher , Utsav Prabhu , Caroline Pantofaru
IPC: H04N21/442 , G06T7/70 , H04N21/258 , H04N21/41 , H04W12/64
CPC classification number: H04N21/44218 , G06T7/70 , H04N21/25875 , H04N21/25891 , H04N21/4126 , H04W12/64 , G06T2207/30196
Abstract: Implementations relate to an automated assistant that provides and manages output from one or more elements of output hardware of a computing device. The automated assistant manages dynamic adjustment of access permissions to the computing device according to, for example, a detected presence of one or more users. An active-user queue can be established each time a unique user enters a viewing window of a camera of the computing device when, up to that point, no user was considered active. Multiple image frames can be captured via the camera and processed to determine whether an initial user remains in the viewing window and/or whether another user has entered the viewing window. The initial user can be considered active as long as they are exclusively detected in the viewing window. Restricted content associated with the user may be rendered by the computing device whilst the user is active.
-
公开(公告)号:US11789522B2
公开(公告)日:2023-10-17
申请号:US17135272
申请日:2020-12-28
Applicant: Google LLC
Inventor: Tuan Nguyen , Kenneth Mixter , Yuan Yuan
CPC classification number: G06F3/011 , G06F3/013 , G06F3/017 , G06F3/0304 , G06F3/0482 , G06F3/167 , G06F9/453 , G06F18/22 , G06T7/74 , G06V40/20
Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.
-
公开(公告)号:US20230253009A1
公开(公告)日:2023-08-10
申请号:US18135611
申请日:2023-04-17
Applicant: GOOGLE LLC
Inventor: Jaclyn Konzelmann , Kenneth Mixter , Sourish Chaudhuri , Tuan Nguyen , Hideaki Matsui , Caroline Pantofaru , Vinay Bettadapura
Abstract: Hot-word free adaptation of one or more function(s) of an automated assistant. Sensor data, from one or more sensor components of an assistant device that provides an automated assistant interface (graphical and/or audible), is processed to determine occurrence and/or confidence metric(s) of various attributes of a user that is proximal to the assistant device. Whether to adapt each of one or more of the function(s) of the automated assistant is based on the occurrence and/or the confidence of one or more of the various attributes. For example, certain processing of at least some of the sensor data can be initiated, such as initiating previously dormant local processing of at least some of the sensor data and/or initiating transmission of at least some of the audio data to remote automated assistant component(s).
-
公开(公告)号:US20230229229A1
公开(公告)日:2023-07-20
申请号:US18126717
申请日:2023-03-27
Applicant: GOOGLE LLC
Inventor: Kenneth Mixter , Yuan Yuan , Tuan Nguyen
CPC classification number: G06F3/011 , G06F3/167 , G06V40/19 , G06V40/164
Abstract: Adapting an automated assistant based on detecting: movement of a mouth of a user; and/or that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. The detecting of the mouth movement and/or the directed gaze can be based on processing of vision data from one or more vision components associated with the assistant device, such as a camera incorporated in the assistant device. The mouth movement that is detected can be movement that is indicative of a user (to whom the mouth belongs) speaking.
-
公开(公告)号:US11704940B2
公开(公告)日:2023-07-18
申请号:US17580334
申请日:2022-01-20
Applicant: Google LLC
Inventor: Diego Melendo Casado , Tuan Nguyen , Jaclyn Konzelmann , Gustavo Moura , Tanya Kraljic
CPC classification number: G06V40/50 , G06V40/161 , G06V40/70 , G10L17/00 , G10L17/04
Abstract: Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.
-
公开(公告)号:US11614794B2
公开(公告)日:2023-03-28
申请号:US16606030
申请日:2018-05-04
Applicant: Google LLC
Inventor: Kenneth Mixter , Yuan Yuan , Tuan Nguyen
IPC: G06F3/16 , G06F3/01 , G06F3/0481 , G06V40/19 , G06V40/16
Abstract: Adapting an automated assistant based on detecting: movement of a mouth of a user; and/or that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. The detecting of the mouth movement and/or the directed gaze can be based on processing of vision data from one or more vision components associated with the assistant device, such as a camera incorporated in the assistant device. The mouth movement that is detected can be movement that is indicative of a user (to whom the mouth belongs) speaking.
-
公开(公告)号:US20230053873A1
公开(公告)日:2023-02-23
申请号:US17981181
申请日:2022-11-04
Applicant: GOOGLE LLC
Inventor: Yuan Yuan , Kenneth Mixter , Tuan Nguyen
Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.
-
公开(公告)号:US20220310094A1
公开(公告)日:2022-09-29
申请号:US17211409
申请日:2021-03-24
Applicant: Google LLC
Inventor: Tuan Nguyen , Yuan Yuan
Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are usable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands. Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.
-
公开(公告)号:US20220159340A1
公开(公告)日:2022-05-19
申请号:US17588467
申请日:2022-01-31
Applicant: GOOGLE LLC
Inventor: Jaclyn Konzelmann , Tuan Nguyen , Vinay Bettadapura , Andrew Gallagher , Utsav Prabhu , Caroline Pantofaru
IPC: H04N21/442 , G06T7/70 , H04N21/258 , H04N21/41
Abstract: Implementations relate to an automated assistant that provides and manages output from one or more elements of output hardware of a computing device. The automated assistant manages dynamic adjustment of access permissions to the computing device according to, for example, a detected presence of one or more users. An active-user queue can be established each time a unique user enters a viewing window of a camera of the computing device when, up to that point, no user was considered active. Multiple image frames can be captured via the camera and processed to determine whether an initial user remains in the viewing window and/or whether another user has entered the viewing window. The initial user can be considered active as long as they are exclusively detected in the viewing window. Restricted content associated with the user may be rendered by the computing device whilst the user is active.
-
-
-
-
-
-
-
-
-