公开(公告)号：US11238868B2

公开(公告)日：2022-02-01

申请号：US16614224

申请日：2019-06-13

Applicant: Google LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/22 ,  G10L15/26 ,  G06F3/16

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US20210240756A1

公开(公告)日：2021-08-05

申请号：US17234084

申请日：2021-04-19

Applicant: Google LLC

Inventor： Alexander Taboriskiy ,  Emmanuel Mogenet ,  Oliver Heckmann ,  Matsvei Zhdanovich ,  Gokhan Hasan Bakir ,  Behshad Behzadi ,  Karoly Csalogany

IPC: G06F16/438 ,  G06F16/432 ,  H04N21/4722 ,  H04N21/422 ,  G06F16/48

Abstract: Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device, wherein a mobile application executing on the mobile device and a media application executing on the media playback device exchange media playback information; activating a microphone associated with the mobile device to receive ambient sounds in response to associating with the media playback device; converting the received ambient sounds to one or more text inputs; determining whether the text inputs include a trigger term that corresponds to a request to initiate a query relating to the presented media content and the query; in response to determining that the trigger term has been included in the text inputs, determining the media playback information from the media application that includes timing information corresponding to when during the presentation of the media content the query was received and media content identification information; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting at least a portion of the search result to the query on a mobile display associated with the mobile device.

公开(公告)号：US11057333B2

公开(公告)日：2021-07-06

申请号：US16369680

申请日：2019-03-29

Applicant: Google LLC

Inventor： Tilke Judd ,  Yariv Adan ,  Zaheed Sabur ,  Behshad Behzadi ,  Lucas Mirelmann ,  Jan Lamecki ,  Dhruv Bakshi

IPC: H04L12/58 ,  H04L29/08 ,  G06Q10/10 ,  G06F16/955 ,  G06F16/93 ,  G06F40/134 ,  G06F40/186 ,  G06F3/0482 ,  H04W4/12 ,  H04W4/02

Abstract: Methods, apparatus, systems, and computer-readable media are provided for incorporating application links into message exchange threads. One or more cues emanating from a message exchange thread involving two or more message exchange clients may be detected. The one or more cues may trigger incorporation, into the message exchange thread, of a selectable link to a distinct application. At least one candidate application that is installed on a given client computing device operated by a message exchange thread participant may be identified. The candidate application may be associated with content of the message exchange thread. A selectable link may be incorporated into a transcript of the message exchange thread displayed in a graphical user interface of a message exchange client operating on the given client computing device. The selectable link may be operable by the participant to expose to the participant an interface associated with a respective candidate application.

公开(公告)号：US10984038B2

公开(公告)日：2021-04-20

申请号：US16272469

申请日：2019-02-11

Applicant: Google LLC

Inventor： Alexander Taboriskiy ,  Emmanuel Mogenet ,  Oliver Heckmann ,  Matsvei Zhdanovich ,  Gokhan Hasan Bakir ,  Behshad Behzadi ,  Karoly Csalogany

IPC: G06F16/438 ,  G06F16/432 ,  H04N21/4722 ,  H04N21/422 ,  G06F16/48

Abstract: Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device, wherein a mobile application executing on the mobile device and a media application executing on the media playback device exchange media playback information; activating a microphone associated with the mobile device to receive ambient sounds in response to associating with the media playback device; converting the received ambient sounds to one or more text inputs; determining whether the text inputs include a trigger term that corresponds to a request to initiate a query relating to the presented media content and the query; in response to determining that the trigger term has been included in the text inputs, determining the media playback information from the media application that includes timing information corresponding to when during the presentation of the media content the query was received and media content identification information; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting at least a portion of the search result to the query on a mobile display associated with the mobile device.

公开(公告)号：US20200272690A1

公开(公告)日：2020-08-27

申请号：US16698350

申请日：2019-11-27

Applicant: Google LLC

Inventor： Nathan David Howard ,  Gabor Simko ,  Andrei Giurgiu ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki

IPC: G06F17/27 ,  G06F16/903 ,  G06F16/901 ,  G06N5/02

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for detecting a continued conversation are disclosed. In one aspect, a method includes the actions of receiving first audio data of a first utterance. The actions further include obtaining a first transcription of the first utterance. The actions further include receiving second audio data of a second utterance. The actions further include obtaining a second transcription of the second utterance. The actions further include determining whether the second utterance includes a query directed to a query processing system based on analysis of the second transcription and the first transcription or a response to the first query. The actions further include configuring the data routing component to provide the second transcription of the second utterance to the query processing system as a second query or bypass routing the second transcription.

公开(公告)号：US10592571B1

公开(公告)日：2020-03-17

申请号：US15791079

申请日：2017-10-23

Applicant: Google LLC

Inventor： Gokhan H. Bakir ,  Behshad Behzadi

IPC: G06F16/00 ,  G06F16/9535 ,  G06F16/248 ,  G06F16/332 ,  G06F16/583

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, modifying queries based on non-textual content. In one aspect, a method includes receiving, from a user device, a query including a plurality of terms; determining active non-textual data displayed in an application environment on the user device; determining, from the non-textual textual data, modification data for the query; generating a set of modified queries based on the query and the modification parameters; scoring the modified queries according to one or more scoring criteria; selecting one of the modified queries based on the scoring; and providing, to the user device, search results responsive to the selected modified query.

公开(公告)号：US20190370326A1

公开(公告)日：2019-12-05

申请号：US15991513

申请日：2018-05-29

Applicant: Google LLC

Inventor： Mugurel Ionut Andreica ,  Tatsiana Sakhar ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki ,  Adrian-Marius Dumitran

IPC: G06F17/27 ,  G06F17/30

Abstract: In some implementations, a query that includes a sequence of terms is obtained, the query is mapped, based on the sequence of the terms, to a dependency tree that represents dependencies among the terms in the query, an entity type that corresponds to an entity sought by the query is determined based on a term represented by a root of the dependency tree, a particular entity is identified based on both the entity type and a relevance of the entity to the terms in the query, and a response to the query is provided based on the particular entity that is identified

公开(公告)号：US20190095523A1

公开(公告)日：2019-03-28

申请号：US16135205

申请日：2018-09-19

Applicant: Google LLC

Inventor： Vladimir Vuskovic ,  Joseph Lange ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki

IPC: G06F17/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating subqueries from a query. In one aspect, a method includes obtaining a query, generating a set of two subqueries from the query, where the set includes a first subquery and a second subquery, determining a quality score for the set of two subqueries, determining whether the quality score for the set of two subqueries satisfies a quality threshold, and in response to determining that the quality score for the set of two subqueries satisfies the quality threshold, providing a first response to the first subquery that is responsive to a first operation that receives the first subquery as input and providing a second response to the second subquery that is responsive to a second operation that receives the second subquery as input.

公开(公告)号：US20190068537A1

公开(公告)日：2019-02-28

申请号：US16170652

申请日：2018-10-25

Applicant: GOOGLE LLC

Inventor： Tilke Judd ,  Yariv Adan ,  Zaheed Sabur ,  Behshad Behzadi ,  Lucas Mirelmann ,  Jan Lamecki ,  Dhruv Bakshi

IPC: H04L12/58 ,  H04L29/08 ,  G06F9/48

Abstract: Methods, apparatus, systems, and computer-readable media are provided for: operating an instance of a personal assistant module to serve a user while the user operates the client computing device, wherein the instance of the personal assistant module has access to a persistent record of a message exchange thread between the user and instance(s) of the personal assistant module; detecting cue(s) emanating from the persistent message exchange thread; identifying candidate application(s) that are installed on a client computing device operated by the user, wherein the candidate application(s) are associated with content of the message exchange thread; and incorporating, into a transcript of the message exchange thread that is displayed in a graphical user interface rendered on the client computing device, selectable link (operable by the user to cause the client computing device to expose to the user an interface associated with a respective candidate application.

公开(公告)号：US10127909B2

公开(公告)日：2018-11-13

申请号：US15877173

申请日：2018-01-22

Applicant: Google LLC

Inventor： Gleb Skobeltsyn ,  Evgeny A. Cherepanov ,  Behshad Behzadi

IPC: G10L15/00 ,  G10L15/22 ,  G06F17/30 ,  G06F17/27 ,  G10L15/08 ,  G10L15/01 ,  G10L15/187

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for natural language processing. One of the methods includes receiving a first voice query; generating a first recognition output; receiving a second voice query; determining from a recognition of the second voice query that the second voice query triggers a correction request; using the first recognition output and the second recognition to determine a plurality of candidate corrections; scoring each candidate correction; and generating a corrected recognition output for a particular candidate correction having a score that satisfies a threshold value.