公开(公告)号：US11935535B2

公开(公告)日：2024-03-19

申请号：US17832049

申请日：2022-06-03

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Raunaq Shah

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/28 ,  G10L15/30 ,  H04M1/27 ,  H04M3/493 ,  H04N21/20 ,  H04N21/239 ,  H04N21/40 ,  H04N21/41 ,  H04N21/4147 ,  H04N21/422 ,  H04N21/47 ,  H04N21/4722 ,  H04N21/45 ,  H04N21/475

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/28 ,  G10L15/30 ,  H04M1/271 ,  H04M3/493 ,  H04N21/20 ,  H04N21/2393 ,  H04N21/40 ,  H04N21/4104 ,  H04N21/4112 ,  H04N21/4147 ,  H04N21/42203 ,  H04N21/42204 ,  H04N21/47 ,  H04N21/4722 ,  G10L2015/223 ,  H04N21/42206 ,  H04N21/4532 ,  H04N21/4751

Abstract: An electronic device configures a device-agnostic voice assistant library for execution on the electronic device based on the electronic device having a first device type. The electronic device also selects an implementation for the voice assistant library. After the configuring, the electronic device receives a verbal input from a user. It extracts request information from the verbal input by processing the verbal input using the voice assistant library executing on the device. It transmits a request to a remote system, the request including the extracted request information. The electronic device receives a response to the request. The response is generated by the remote system in accordance with the extracted request information. The electronic device performs an operation in accordance with the response by one or more voice processing modules of the configured voice assistant library.

公开(公告)号：US11688417B2

公开(公告)日：2023-06-27

申请号：US16622771

申请日：2019-05-02

Applicant: Google LLC

Inventor： Jaclyn Konzelmann ,  Kenneth Mixter ,  Sourish Chaudhuri ,  Tuan Nguyen ,  Hideaki Matsui ,  Caroline Pantofaru ,  Vinay Bettadapura

IPC: G10L25/78 ,  G06F3/16 ,  G06V40/18 ,  G06F40/30

CPC classification number: G10L25/78 ,  G06F3/167 ,  G06V40/18 ,  G06F40/30

Abstract: Hot-word free adaptation of one or more function(s) of an automated assistant. Sensor data, from one or more sensor components of an assistant device that provides an automated assistant interface (graphical and/or audible), is processed to determine occurrence and/or confidence metric(s) of various attributes of a user that is proximal to the assistant device. Whether to adapt each of one or more of the function(s) of the automated assistant is based on the occurrence and/or the confidence of one or more of the various attributes. For example, certain processing of at least some of the sensor data can be initiated, such as initiating previously dormant local processing of at least some of the sensor data and/or initiating transmission of at least some of the audio data to remote automated assistant component(s).

公开(公告)号：US20220293104A1

公开(公告)日：2022-09-15

申请号：US17832049

申请日：2022-06-03

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Raunaq Shah

IPC: G10L15/22 ,  H04N21/40 ,  H04N21/20 ,  H04N21/4722 ,  H04N21/4147 ,  H04N21/47 ,  H04M3/493 ,  H04N21/422 ,  H04N21/41 ,  G06F3/16 ,  H04N21/239 ,  H04M1/27

Abstract: An electronic device configures a device-agnostic voice assistant library for execution on the electronic device based on the electronic device having a first device type. The electronic device also selects an implementation for the voice assistant library. After the configuring, the electronic device receives a verbal input from a user. It extracts request information from the verbal input by processing the verbal input using the voice assistant library executing on the device. It transmits a request to a remote system, the request including the extracted request information. The electronic device receives a response to the request. The response is generated by the remote system in accordance with the extracted request information. The electronic device performs an operation in accordance with the response by one or more voice processing modules of the configured voice assistant library.

公开(公告)号：US20210400348A1

公开(公告)日：2021-12-23

申请号：US16903606

申请日：2020-06-17

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Marci Meingast ,  Jennifer Yick

IPC: H04N21/466 ,  H04N21/482 ,  H04N21/45 ,  H04N21/436 ,  H04N21/4363

Abstract: Systems and techniques are provided for automation and recommendation based on device control protocols. HDMI-CEC device control data may be received from a connected electronic device that may be connected to an electronic display device. The HDMI-CEC device control data may be based on a HDMI-CEC device control signal from the electronic display device. Signals may be received from sensor devices located in a same structure as the electronic display device. The HDMI-CEC device control data and signals from the sensor devices may be input to the machine learning system. The machine learning system may generate a control signal for a device. The control signal may be sent to the device to be implemented by the device.

公开(公告)号：US20210249015A1

公开(公告)日：2021-08-12

申请号：US17242273

申请日：2021-04-27

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Diego Melendo Casado ,  Alexander Houston Gruenstein ,  Terry Tai ,  Christopher Thaddeus Hughes ,  Matthew Nirvan Sharifi

IPC: G10L15/22 ,  G10L15/32

Abstract: The various implementations described herein include methods and systems for determining device leadership among voice interface devices. In one aspect, a method is performed at a first electronic device of a plurality of electronic devices, each having microphones, a speaker, processors, and memory storing programs for execution by the processors. The first device detects a voice input. It determines a device state and a relevance of the voice input. It identifies a subset of electronic devices from the plurality to which the voice input is relevant. In accordance with a determination that the subset includes the first device, the first device determines a first score of a criterion associated with the voice input and receives second scores of the criterion from other devices in the subset. In accordance with a determination that the first score is higher than the second scores, the first device responds to the detected input.

公开(公告)号：US10890969B2

公开(公告)日：2021-01-12

申请号：US16606529

申请日：2018-05-04

Applicant: Google LLC

Inventor： Yuan Yuan ,  Kenneth Mixter ,  Tuan Nguyen

IPC: G06F3/01 ,  G06F3/13 ,  G06F3/16 ,  G10L15/22

Abstract: Invoking one or more previously dormant functions of an automated assistant in response to detecting, based on processing of vision data from one or more vision components: (1) a particular gesture (e.g., of one or more “invocation gestures”) of a user; and/or (2) detecting that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. For example, the previously dormant function(s) can be invoked in response to detecting the particular gesture, detecting that the gaze of the user is directed at an assistant device for at least a threshold amount of time, and optionally that the particular gesture and the directed gaze of the user co-occur or occur within a threshold temporal proximity of one another.

公开(公告)号：US10783883B2

公开(公告)日：2020-09-22

申请号：US15801307

申请日：2017-11-01

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Tomer Shekel ,  Tuan Anh Nguyen

IPC: G10L15/18 ,  G06F17/21 ,  G10L15/22 ,  G06F3/16 ,  H04L12/28 ,  H04L29/08 ,  H04N21/472

Abstract: A method at a first electronic device of a local group of connected electronic devices includes: receiving a first voice command including a request for a first operation; determining a first target device for the first operation from among the local group; establishing a focus session with respect to the first target device; causing the first operation to be performed by the first target device; receiving a second voice command including a request for a second operation; determining that the second voice command does not include an explicit designation of a second target device; determining that the second operation can be performed by the first target device; determining whether the second voice command satisfies one or more focus session maintenance criteria; and if the second voice command satisfies the focus session maintenance criteria, causing the second operation to be performed by the first target device.

公开(公告)号：US20200167597A1

公开(公告)日：2020-05-28

申请号：US16618532

申请日：2018-05-04

Applicant: Google LLC

Inventor： Tuan Nguyen ,  Kenneth Mixter ,  Yuan Yuan

IPC: G06K9/62 ,  G06K9/00 ,  G06F9/451 ,  G06T7/73 ,  G06F3/16 ,  G06F3/01 ,  G06F3/03

Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.

公开(公告)号：US20190221227A1

公开(公告)日：2019-07-18

申请号：US16367174

申请日：2019-03-27

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter

IPC: G10L21/0232 ,  G06F16/632 ,  G10L15/22 ,  G10L25/84 ,  G10L25/51 ,  G10L15/30 ,  G10L15/20 ,  G10L15/08

Abstract: A method at an electronic device with one or more microphones and a speaker, the electronic device configured to be responsive to any of a plurality of affordances including a voice-based affordance, includes determining background noise of an environment associated with the electronic device, and before detecting the voice-based affordance: determining whether the background noise would interfere with recognition of the hotword in voice inputs detected by the electronic device, and if so, indicating to a user to use an affordance other than the voice-based affordance.

公开(公告)号：US20180308324A1

公开(公告)日：2018-10-25

申请号：US16020971

申请日：2018-06-27

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Raunaq Shah

IPC: G08B5/36 ,  H05B37/02 ,  G06F3/16 ,  G10L13/033 ,  G10L15/22 ,  H04L12/28 ,  H04N21/422 ,  H04N21/41 ,  H04N21/239 ,  H04N7/025 ,  H04N5/445 ,  H04N5/44 ,  H04M3/493 ,  H04M1/27

Abstract: The disclosed embodiments include methods, devices, and storage mediums for adjusting the output volume of audio content. In one aspect, a method performed at an audio device includes: (1) identifying a remote location for audio content; (2) streaming the audio content from the remote location; (3) producing an audible output from the audio content at a first volume level; and (4) while producing the audible output: (a) receiving an indication that a user is about to submit verbal input to the electronic device; (b) in response to the indication, adjusting the audible output from the first volume level to a second volume level, less than the first volume level; (c) receiving the verbal input from the user; and (d) after receiving the verbal input, adjusting the audible output from the second volume level to the first volume level.