公开(公告)号：US20190230056A1

公开(公告)日：2019-07-25

申请号：US16369680

申请日：2019-03-29

Applicant: Google LLC

Inventor： Tilke Judd ,  Yariv Adan ,  Zaheed Sabur ,  Behshad Behzadi ,  Lucas Mirelmann ,  Jan Lamecki ,  Dhruv Bakshi

IPC: H04L12/58 ,  G06F16/93 ,  H04W4/12 ,  H04W4/02 ,  H04L29/08 ,  G06F3/0482 ,  G06F16/955 ,  G06Q10/10 ,  G06F17/24 ,  G06F17/22

Abstract: Methods, apparatus, systems, and computer-readable media are provided for incorporating application links into message exchange threads. One or more cues emanating from a message exchange thread involving two or more message exchange clients may be detected. The one or more cues may trigger incorporation, into the message exchange thread, of a selectable link to a distinct application. At least one candidate application that is installed on a given client computing device operated by a message exchange thread participant may be identified. The candidate application may be associated with content of the message exchange thread. A selectable link may be incorporated into a transcript of the message exchange thread displayed in a graphical user interface of a message exchange client operating on the given client computing device. The selectable link may be operable by the participant to expose to the participant an interface associated with a respective candidate application.

公开(公告)号：US20190138527A1

公开(公告)日：2019-05-09

申请号：US16241444

申请日：2019-01-07

Applicant: Google LLC

Inventor： Nils Grimsmo ,  Behshad Behzadi ,  Fredrik Bergenlid

IPC: G06F16/2457 ,  G06F16/9535 ,  G06F16/9537 ,  G06F16/242

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query implicitly references some entity, and in response: obtaining an approximate location and an approximate orientation of the user device, obtaining a set of entities including one or more entities, each entity in the set of entities being at least partially within a range that is based on the approximate location and that includes an extended portion based on the approximate orientation, selecting an entity from the set of entities, and providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.

公开(公告)号：US20190036856A1

公开(公告)日：2019-01-31

申请号：US15953266

申请日：2018-04-13

Applicant: Google LLC

Inventor： Fredrik Bergenlid ,  Vladyslav Lysychkin ,  Denis Burakov ,  Behshad Behzadi ,  Andrea Terwisscha van Scheltinga ,  Quentin Lascombes de Laroussilhe ,  Mikhail Golikov ,  Koa Metter ,  Ibrahim Badr ,  Zaheed Sabur

IPC: H04L12/58 ,  H04N7/15 ,  G06F17/30

CPC classification number: H04L51/10 ,  G06F16/44 ,  G10L15/005 ,  G10L15/16 ,  G10L15/22 ,  G10L25/63 ,  G10L2015/223 ,  H04N7/15 ,  H04N21/4394 ,  H04N21/4788

Abstract: Implementations relate to providing information items for display during a communication session. In some implementations, a computer-implemented method includes receiving, during a communication session between a first computing device and a second computing device, first media content from the communication session. The method further includes determining a first information item for display in the communication session based at least in part on the first media content. The method further includes sending a first command to at least one of the first computing device and the second computing device to display the first information item.

公开(公告)号：US20180336449A1

公开(公告)日：2018-11-22

申请号：US15847341

申请日：2017-12-19

Applicant: Google LLC

Inventor： Yariv Adan ,  Vladimir Vuskovic ,  Behshad Behzadi

IPC: G06N3/00 ,  G06Q10/06 ,  G06Q10/02 ,  G10L15/22 ,  G10L13/04

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F17/30654 ,  G10L13/00 ,  G10L2015/223 ,  H04M3/4936 ,  H04M2203/355

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed by the computational assistant; responsive to determining, by the computational assistant, that complete performance of the task will take more than a threshold amount of time, outputting, for playback by one or more speakers operably connected to the computing device, synthesized voice data that informs a user of the computing device that complete performance of the task will not be immediate; and performing, by the computational assistant, the task.

公开(公告)号：US12216700B2

公开(公告)日：2025-02-04

申请号：US17234084

申请日：2021-04-19

Applicant: Google LLC

Inventor： Alexander Taboriskiy ,  Emmanuel Mogenet ,  Oliver Heckmann ,  Matsvei Zhdanovich ,  Gokhan Hasan Bakir ,  Behshad Behzadi ,  Karoly Csalogany

IPC: G06F16/438 ,  G06F16/432 ,  G06F16/48 ,  H04N21/422 ,  H04N21/4722

Abstract: Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device, wherein a mobile application executing on the mobile device and a media application executing on the media playback device exchange media playback information; activating a microphone associated with the mobile device to receive ambient sounds in response to associating with the media playback device; converting the received ambient sounds to one or more text inputs; determining whether the text inputs include a trigger term that corresponds to a request to initiate a query relating to the presented media content and the query; in response to determining that the trigger term has been included in the text inputs, determining the media playback information from the media application that includes timing information corresponding to when during the presentation of the media content the query was received and media content identification information; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting at least a portion of the search result to the query on a mobile display associated with the mobile device.

公开(公告)号：US20240420699A1

公开(公告)日：2024-12-19

申请号：US18815252

申请日：2024-08-26

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Alvin Abdagic ,  Behshad Behzadi ,  Jacopo Sannazzaro Natta ,  Julia Proskurnia ,  Krzysztof Andrzej Goj ,  Srikanth Pandiri ,  Viesturs Zarins ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Luv Kothari

IPC: G10L15/26 ,  G06F3/0488 ,  G06N20/00 ,  G10L15/18 ,  G10L15/22

Abstract: Systems and methods described herein relate to determining whether to incorporate recognized text, that corresponds to a spoken utterance of a user of a client device, into a transcription displayed at the client device, or to cause an assistant command, that is associated with the transcription and that is based on the recognized text, to be performed by an automated assistant implemented by the client device. The spoken utterance is received during a dictation session between the user and the automated assistant. Implementations can process, using automatic speech recognition model(s), audio data that captures the spoken utterance to generate the recognized text. Further, implementations can determine whether to incorporate the recognized text into the transcription or cause the assistant command to be performed based on touch input being directed to the transcription, a state of the transcription, and/or audio-based characteristic(s) of the spoken utterance.

公开(公告)号：US20240420697A1

公开(公告)日：2024-12-19

申请号：US18815514

申请日：2024-08-26

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US20240411513A1

公开(公告)日：2024-12-12

申请号：US18808933

申请日：2024-08-19

Applicant: GOOGLE LLC

Inventor： Srikanth Pandiri ,  Luv Kothari ,  Behshad Behzadi ,  Zaheed Sabur ,  Domenico Carbotta ,  Akshay Kannan ,  Qi Wang ,  Gokay Baris Gultekin ,  Angana Ghosh ,  Xu Liu ,  Yang Lu ,  Steve Cheng

IPC: G06F3/16 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

Abstract: Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

公开(公告)号：US12141672B2

公开(公告)日：2024-11-12

申请号：US18367828

申请日：2023-09-13

Applicant: GOOGLE LLC

Inventor： Yariv Adan ,  Vladimir Vuskovic ,  Behshad Behzadi

IPC: G06N3/006 ,  G06F3/16 ,  G06F16/332 ,  G06Q10/02 ,  G06Q10/0631 ,  G10L13/00 ,  G10L15/22 ,  H04M3/493

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed by the computational assistant; responsive to determining, by the computational assistant, that complete performance of the task will take more than a threshold amount of time, outputting, for playback by one or more speakers operably connected to the computing device, synthesized voice data that informs a user of the computing device that complete performance of the task will not be immediate; and performing, by the computational assistant, the task.

公开(公告)号：US20240355327A1

公开(公告)日：2024-10-24

申请号：US18623853

申请日：2024-04-01

Applicant: GOOGLE LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/30 ,  H04L67/01 ,  H04L67/568

CPC classification number: G10L15/22 ,  G06F3/165 ,  G06F3/167 ,  G10L15/1815 ,  G10L15/30 ,  H04L67/568 ,  G10L2015/223 ,  H04L67/01

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.