公开(公告)号：US11749280B2

公开(公告)日：2023-09-05

申请号：US18086263

申请日：2022-12-21

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L2015/223 ,  G10L2015/227

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US11482217B2

公开(公告)日：2022-10-25

申请号：US16621540

申请日：2019-05-31

Applicant: Google LLC

Inventor： Michael Golikov ,  Zaheed Sabur ,  Denis Burakov ,  Behshad Behzadi ,  Sergey Nazarov ,  Daniel Cotting ,  Mario Bertschler ,  Lucas Mirelmann ,  Steve Cheng ,  Bohdan Vlasyuk ,  Jonathan Lee ,  Lucia Terrenghi ,  Adrian Zumbrunnen

IPC: G10L15/22 ,  G01D21/02 ,  G06F3/16 ,  G10L15/06 ,  G10L15/18 ,  G10L15/183 ,  G10L25/78

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant by, for example, obviating the need to provide an explicit invocation to the automated assistant, such as by saying a hot-word/phrase or performing a specific user input, prior to speaking a command or query. In addition, the automated assistant can optionally receive, understand, and/or respond to the command or query without communicating with a server, thereby further reducing the time in which a response can be provided. Implementations only selectively initiate on-device speech recognition responsive to determining one or more condition(s) are satisfied. Further, in some implementations, on-device NLU, on-device fulfillment, and/or resulting execution occur only responsive to determining, based on recognized text form the on-device speech recognition, that such further processing should occur. Thus, through selective activation of on-device speech processing, and/or selective activation of on-device NLU and/or on-device fulfillment, various client device resources are conserved.

公开(公告)号：US20210344761A1

公开(公告)日：2021-11-04

申请号：US17379073

申请日：2021-07-19

Applicant: Google LLC

Inventor： Zaheed Sabur ,  Andrea Terwisscha van Scheltinga ,  Mikhail Reutov ,  Lucas Mirelmann

IPC: H04L29/08 ,  G06F3/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pairing a speech-enabled device with a display device. A determination may be made to pair a speech-enabled device with a display device of a particular type. A set of display devices that are associated with the speech-enabled device may be identified in response to determining to pair the speech-enabled device with the display device of the particular type. An instruction may be provided to each of the display devices. The instruction may cause the display device to determine (i) whether the display device is of the particular type and (ii) whether the display device and the speech-enabled device both share a local area network and display on the display device an indication regarding pairing with the speech-enabled device.

公开(公告)号：US20240272970A1

公开(公告)日：2024-08-15

申请号：US18648842

申请日：2024-04-29

Applicant: GOOGLE LLC

Inventor： Bohdan Vlasyuk ,  Behshad Behzadi ,  Mario Bertschler ,  Denis Burakov ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Jonathan Lee ,  Lucia Terrenghi ,  Adrian Zumbrunnen

IPC: G06F9/54 ,  G06F3/16 ,  G06F40/166 ,  G06F40/35 ,  G10L15/22 ,  G10L15/26

CPC classification number: G06F9/547 ,  G06F3/167 ,  G06F40/166 ,  G06F40/35 ,  G10L15/22 ,  G10L15/26 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.

公开(公告)号：US20240185857A1

公开(公告)日：2024-06-06

申请号：US18439411

申请日：2024-02-12

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschlewr ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/26 ,  G06F3/16 ,  G10L15/22

CPC classification number: G10L15/26 ,  G06F3/167 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US11553051B2

公开(公告)日：2023-01-10

申请号：US17379073

申请日：2021-07-19

Applicant: Google LLC

Inventor： Zaheed Sabur ,  Andrea Terwisscha van Scheltinga ,  Mikhail Reutov ,  Lucas Mirelmann

IPC: H04L67/51 ,  H04W8/00 ,  G06F3/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pairing a speech-enabled device with a display device. A determination may be made to pair a speech-enabled device with a display device of a particular type. A set of display devices that are associated with the speech-enabled device may be identified in response to determining to pair the speech-enabled device with the display device of the particular type. An instruction may be provided to each of the display devices. The instruction may cause the display device to determine (i) whether the display device is of the particular type and (ii) whether the display device and the speech-enabled device both share a local area network and display on the display device an indication regarding pairing with the speech-enabled device.

公开(公告)号：US20220157317A1

公开(公告)日：2022-05-19

申请号：US17588481

申请日：2022-01-31

Applicant: Google LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey NAZAROV ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/26 ,  G06F3/16 ,  G10L15/22

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US20220130386A1

公开(公告)日：2022-04-28

申请号：US17572293

申请日：2022-01-10

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G10L15/18 ,  G06N3/00

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

公开(公告)号：US11232792B2

公开(公告)日：2022-01-25

申请号：US16829323

申请日：2020-03-25

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G10L15/18 ,  G06N3/00

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

公开(公告)号：US11222637B2

公开(公告)日：2022-01-11

申请号：US16613705

申请日：2019-05-31

Applicant: Google LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey Nazarov ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve Cheng ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant. Should the user command the automated assistant in a way that is aligned with a pre-cached, predicted interaction, the automated assistant will exhibit instant fulfillment of the command, thereby eliminating any latency that the user would have otherwise experienced interacting with the automated assistant.