公开(公告)号：US11990128B2

公开(公告)日：2024-05-21

申请号：US17979174

申请日：2022-11-02

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Tomer Shekel ,  Tuan Anh Nguyen

IPC: G10L15/22 ,  G06F3/16 ,  G06F40/40 ,  H04L12/28 ,  H04L67/306 ,  H04N21/472

CPC classification number: G10L15/22 ,  G06F3/167 ,  H04L12/282 ,  H04L67/306 ,  H04N21/47217 ,  G10L2015/223 ,  G10L2015/228

Abstract: A first electronic device of a local group of connected electronic devices receives a first voice command including a request for a first operation assigns a first target device from among a local group of connected electronic devices as an in-focus device for performing the first operation, causes the first operation to be performed by the first target device via operation of a server-implemented common network service, receives a second voice command including a request for a second operation and based on a determination that the second voice command does not include an explicit designation of a second target device and a determination that the second operation can be performed by the first target device, assigning the first target device.

公开(公告)号：US11962650B2

公开(公告)日：2024-04-16

申请号：US18001569

申请日：2021-06-28

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Ken MacKay ,  Byungchul Kim

IPC: H04L67/12 ,  G06F8/71 ,  G06F21/44 ,  H04L67/51

CPC classification number: H04L67/12 ,  G06F8/71 ,  G06F21/44 ,  H04L67/51

Abstract: Systems and techniques are provided for distributed ambient computing within an environment. A first version of an ambient computing library running on a device may check a manifest in the storage of the device to identify a second device that provides a service. The first version of the ambient computing library may send data to be processed using the service to the second device through a second version of the ambient computing library running on the second device. The first device and the second device may include different computing hardware. The first version of the ambient computing library may receive data including results from the second device through the second version of the ambient computing library. The data including the results may be generated by the second device based on processing the data sent from the device by the first version of the ambient computing library.

公开(公告)号：US11922941B2

公开(公告)日：2024-03-05

申请号：US18226045

申请日：2023-07-25

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Raunaq Shah

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/28 ,  H04M1/27 ,  H04M3/493 ,  H04N21/20 ,  H04N21/239 ,  H04N21/40 ,  H04N21/41 ,  H04N21/4147 ,  H04N21/422 ,  H04N21/47 ,  H04N21/4722 ,  H04N21/45 ,  H04N21/475

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/28 ,  H04M1/271 ,  H04M3/493 ,  H04N21/20 ,  H04N21/2393 ,  H04N21/40 ,  H04N21/4104 ,  H04N21/4112 ,  H04N21/4147 ,  H04N21/42203 ,  H04N21/42204 ,  H04N21/47 ,  H04N21/4722 ,  G10L2015/223 ,  H04N21/42206 ,  H04N21/4532 ,  H04N21/4751

Abstract: An electronic device stores a voice assistant library for execution on the electronic device based on the electronic device having a first device type. The electronic device receives a verbal input from a user. It extracts request information from the verbal input by processing the verbal input using the voice assistant library executing on the device. It transmits a request to a remote system. The electronic device receives a response to the request. The response is generated by the remote system. The electronic device performs an operation in accordance with the response by one or more voice-processing modules of the configured voice assistant library.

公开(公告)号：US20240028108A1

公开(公告)日：2024-01-25

申请号：US18375876

申请日：2023-10-02

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Kenneth Mixter ,  Yuan Yuan

IPC: G06F3/01 ,  G06T7/73 ,  G06F9/451 ,  G06F3/03 ,  G06F3/16 ,  G06F3/0482 ,  G06V40/20 ,  G06F18/22

CPC classification number: G06F3/011 ,  G06T7/74 ,  G06F9/453 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/167 ,  G06F3/0482 ,  G06V40/20 ,  G06F18/22

Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.

公开(公告)号：US11869527B2

公开(公告)日：2024-01-09

申请号：US17225693

申请日：2021-04-08

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter

IPC: G10L15/20 ,  G10L21/0232 ,  G06F16/632 ,  G10L15/08 ,  G10L15/22 ,  G10L15/30 ,  G10L25/51 ,  G10L25/84 ,  G10L21/0216 ,  G10L25/78

CPC classification number: G10L21/0232 ,  G06F16/632 ,  G10L15/08 ,  G10L15/20 ,  G10L15/22 ,  G10L15/30 ,  G10L25/51 ,  G10L25/84 ,  G10L2015/088 ,  G10L2015/223 ,  G10L2021/02161 ,  G10L2025/783

Abstract: A method at an electronic device with one or more microphones and a speaker, the electronic device configured to be responsive to any of a plurality of affordances including a voice-based affordance, includes determining background noise of an environment associated with the electronic device, and before detecting the voice-based affordance: determining whether the background noise would interfere with recognition of the hotword in voice inputs detected by the electronic device, and if so, indicating to a user to use an affordance other than the voice-based affordance.

公开(公告)号：US11789697B2

公开(公告)日：2023-10-17

申请号：US17370656

申请日：2021-07-08

Applicant: GOOGLE LLC

Inventor： Yuan Yuan ,  Johan Schalkwyk ,  Kenneth Mixter

IPC: G10L15/22 ,  G06F3/16 ,  H04N7/14 ,  H04N7/15 ,  G06V40/16

CPC classification number: G06F3/167 ,  G06F3/165 ,  G06V40/174 ,  G10L15/22 ,  H04N7/142 ,  H04N7/15

Abstract: The various implementations described herein include methods, devices, and systems for attending to a presenting user. In one aspect, a method is performed at an electronic device that includes an image sensor, microphones, a display, processor(s), and memory. The device (1) obtains audio signals by concurrently receiving audio data at each microphone; (2) determines based on the obtained audio signals that a person is speaking in a vicinity of the device; (3) obtains video data from the image sensor; (4) determines via the video data that the person is not within a field of view of the image sensor; (5) reorients the electronic device based on differences in the received audio data; (6) after reorienting the electronic device, obtains second video data from the image sensor and determines that the person is within the field of view; and (7) attends to the person by directing the display toward the person.

公开(公告)号：US11789522B2

公开(公告)日：2023-10-17

申请号：US17135272

申请日：2020-12-28

Applicant: Google LLC

Inventor： Tuan Nguyen ,  Kenneth Mixter ,  Yuan Yuan

IPC: G06F3/01 ,  G06T7/73 ,  G06F9/451 ,  G06F3/03 ,  G06F3/16 ,  G06F3/0482 ,  G06V40/20 ,  G06F18/22

CPC classification number: G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0482 ,  G06F3/167 ,  G06F9/453 ,  G06F18/22 ,  G06T7/74 ,  G06V40/20

Abstract: Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.

公开(公告)号：US11785303B2

公开(公告)日：2023-10-10

申请号：US17962688

申请日：2022-10-10

Applicant: Google LLC

Inventor： Kenneth Mixter ,  Marci Meingast ,  Jennifer Yick

IPC: H04N21/466 ,  H04N21/436 ,  H04N21/4363 ,  H04N21/45 ,  H04N21/482

CPC classification number: H04N21/4668 ,  H04N21/43615 ,  H04N21/43635 ,  H04N21/4532 ,  H04N21/4826

Abstract: Systems and techniques are provided for automation and recommendation based on device control protocols. HDMI-CEC device control data may be received from a connected electronic device that may be connected to an electronic display device. The HDMI-CEC device control data may be based on a HDMI-CEC device control signal from the electronic display device. The system may generate a control signal for a device. The control signal may be sent to the device for implementation.

公开(公告)号：US20230253009A1

公开(公告)日：2023-08-10

申请号：US18135611

申请日：2023-04-17

Applicant: GOOGLE LLC

Inventor： Jaclyn Konzelmann ,  Kenneth Mixter ,  Sourish Chaudhuri ,  Tuan Nguyen ,  Hideaki Matsui ,  Caroline Pantofaru ,  Vinay Bettadapura

IPC: G10L25/78 ,  G06F3/16 ,  G06V40/18

CPC classification number: G10L25/78 ,  G06F3/167 ,  G06V40/18 ,  G06F40/30

Abstract: Hot-word free adaptation of one or more function(s) of an automated assistant. Sensor data, from one or more sensor components of an assistant device that provides an automated assistant interface (graphical and/or audible), is processed to determine occurrence and/or confidence metric(s) of various attributes of a user that is proximal to the assistant device. Whether to adapt each of one or more of the function(s) of the automated assistant is based on the occurrence and/or the confidence of one or more of the various attributes. For example, certain processing of at least some of the sensor data can be initiated, such as initiating previously dormant local processing of at least some of the sensor data and/or initiating transmission of at least some of the audio data to remote automated assistant component(s).

公开(公告)号：US20230229229A1

公开(公告)日：2023-07-20

申请号：US18126717

申请日：2023-03-27

Applicant: GOOGLE LLC

Inventor： Kenneth Mixter ,  Yuan Yuan ,  Tuan Nguyen

IPC: G06F3/01 ,  G06F3/16 ,  G06V40/19 ,  G06V40/16

CPC classification number: G06F3/011 ,  G06F3/167 ,  G06V40/19 ,  G06V40/164

Abstract: Adapting an automated assistant based on detecting: movement of a mouth of a user; and/or that a gaze of the user is directed at an assistant device that provides an automated assistant interface (graphical and/or audible) of the automated assistant. The detecting of the mouth movement and/or the directed gaze can be based on processing of vision data from one or more vision components associated with the assistant device, such as a camera incorporated in the assistant device. The mouth movement that is detected can be movement that is indicative of a user (to whom the mouth belongs) speaking.