公开(公告)号：US11102309B2

公开(公告)日：2021-08-24

申请号：US16860706

申请日：2020-04-28

Applicant: Google LLC

Inventor： Zaheed Sabur ,  Andrea Terwisscha van Scheltinga ,  Mikhail Reutov ,  Lucas Mirelmann

IPC: H04L29/08 ,  H04W8/00 ,  G06F3/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pairing a speech-enabled device with a display device. A determination may be made to pair a speech-enabled device with a display device of a particular type. A set of display devices that are associated with the speech-enabled device may be identified in response to determining to pair the speech-enabled device with the display device of the particular type. An instruction may be provided to each of the display devices. The instruction may cause the display device to determine (i) whether the display device is of the particular type and (ii) whether the display device and the speech-enabled device both share a local area network and display on the display device an indication regarding pairing with the speech-enabled device.

公开(公告)号：US20190230056A1

公开(公告)日：2019-07-25

申请号：US16369680

申请日：2019-03-29

Applicant: Google LLC

Inventor： Tilke Judd ,  Yariv Adan ,  Zaheed Sabur ,  Behshad Behzadi ,  Lucas Mirelmann ,  Jan Lamecki ,  Dhruv Bakshi

IPC: H04L12/58 ,  G06F16/93 ,  H04W4/12 ,  H04W4/02 ,  H04L29/08 ,  G06F3/0482 ,  G06F16/955 ,  G06Q10/10 ,  G06F17/24 ,  G06F17/22

Abstract: Methods, apparatus, systems, and computer-readable media are provided for incorporating application links into message exchange threads. One or more cues emanating from a message exchange thread involving two or more message exchange clients may be detected. The one or more cues may trigger incorporation, into the message exchange thread, of a selectable link to a distinct application. At least one candidate application that is installed on a given client computing device operated by a message exchange thread participant may be identified. The candidate application may be associated with content of the message exchange thread. A selectable link may be incorporated into a transcript of the message exchange thread displayed in a graphical user interface of a message exchange client operating on the given client computing device. The selectable link may be operable by the participant to expose to the participant an interface associated with a respective candidate application.

公开(公告)号：US12230272B2

公开(公告)日：2025-02-18

申请号：US18540377

申请日：2023-12-14

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G06N3/006 ,  G10L15/18

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

公开(公告)号：US12106759B2

公开(公告)日：2024-10-01

申请号：US17588481

申请日：2022-01-31

Applicant: Google LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/26

CPC classification number: G10L15/26 ,  G06F3/167 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US20240312461A1

公开(公告)日：2024-09-19

申请号：US18674509

申请日：2024-05-24

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey Nazarov ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve Cheng ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

CPC classification number: G10L15/22 ,  G10L15/083

Abstract: Implementations relate to receiving natural language input that requests an automated assistant to provide information and processing the natural language input to identify the requested information and to identify one or more predicted actions. Those implementations further cause a computing device, at which the natural language input is received, to render the requested information and the one or more predicted actions in response to the natural language input. Yet further, those implementations, in response to the user confirming a rendered predicted action, cause the automated assistant to initialize the predicted action.

公开(公告)号：US11948576B2

公开(公告)日：2024-04-02

申请号：US18136189

申请日：2023-04-18

Applicant: GOOGLE LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G06F3/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  H04L67/01 ,  H04L67/568 ,  H04N23/60

CPC classification number: G10L15/22 ,  G06F3/165 ,  G06F3/167 ,  G10L15/1815 ,  G10L15/30 ,  H04L67/568 ,  G10L2015/223 ,  H04L67/01

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US11900944B2

公开(公告)日：2024-02-13

申请号：US17588481

申请日：2022-01-31

Applicant: Google LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/22 ,  G10L15/26 ,  G06F3/16

CPC classification number: G10L15/26 ,  G06F3/167 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US20230298585A1

公开(公告)日：2023-09-21

申请号：US18202236

申请日：2023-05-25

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey Nazarov ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve Cheng ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

CPC classification number: G10L15/22 ,  G10L15/083

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant. The predicted interaction(s) can include action(s) to be performed by third-party application(s).

公开(公告)号：US20230252989A1

公开(公告)日：2023-08-10

申请号：US18136189

申请日：2023-04-18

Applicant: GOOGLE LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/30 ,  H04L67/568

CPC classification number: G10L15/22 ,  G06F3/165 ,  G06F3/167 ,  G10L15/1815 ,  G10L15/30 ,  H04L67/568 ,  G10L2015/223 ,  H04L67/01

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US11664028B2

公开(公告)日：2023-05-30

申请号：US17569811

申请日：2022-01-06

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey Nazarov ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve Cheng ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

CPC classification number: G10L15/22 ,  G10L15/083

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant. The predicted interaction(s) can include action(s) to be performed by third-party application(s).