Media contextual information from buffered media data

    公开(公告)号:US10679068B2

    公开(公告)日:2020-06-09

    申请号:US15621211

    申请日:2017-06-13

    Applicant: Google Inc.

    Inventor: Ibrahim Badr

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information for presented media. In one aspect, a method includes storing in a buffer, on a first user device, media data as buffered media data, the buffered media data being a most recent portion of media data received at the first user device, the most recent portion inclusive of the media data received from a present time to a prior time that is fixed relative to the present time; responsive to a search operation invocation at the present time, sending the buffered media data to a search processing system that is remote from the first user device; and receiving, from the search processing system and in response to the buffered media data, contextual information regarding an entity that the data processing system identified from processing the buffered media data.

    PROACTIVE INCORPORATION OF UNSOLICITED CONTENT INTO HUMAN-TO-COMPUTER DIALOGS

    公开(公告)号:US20180277108A1

    公开(公告)日:2018-09-27

    申请号:US15466422

    申请日:2017-03-22

    Applicant: Google Inc.

    Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

    Providing contextual actions for mobile onscreen content

    公开(公告)号:US10535005B1

    公开(公告)日:2020-01-14

    申请号:US15386771

    申请日:2016-12-21

    Applicant: GOOGLE INC.

    Abstract: Systems and methods provide an application programming interface to offer action suggestions to third-party applications using context data associated with the third-party. An example method includes receiving content information and context information from a source mobile application, the content information representing information to be displayed on a mobile device as part of a source mobile application administered by a third party, the context information being information specific to the third party and unavailable to a screen scraper. The method also includes predicting an action based on the content information and the context information, the action representing a deep link for a target mobile application. The method further includes providing the action to the source mobile application with a title and a thumbnail, the source mobile application using the title and thumbnail to display a selectable control that, when selected, causes the mobile device to initiate the action.

    Resolving automated assistant requests that are based on image(s) and/or other sensor data

    公开(公告)号:US10275651B2

    公开(公告)日:2019-04-30

    申请号:US15631274

    申请日:2017-06-23

    Applicant: Google Inc.

    Abstract: Methods, apparatus, and computer readable media are described related to causing processing of sensor data to be performed in response to determining a request related to an environmental object that is likely captured by the sensor data. Some implementations further relate to determining whether the request is resolvable based on the processing of the sensor data. When it is determined that the request is not resolvable, a prompt is determined and provided as user interface output, where the prompt provides guidance on further input that will enable the request to be resolved. In those implementations, the further input (e.g., additional sensor data and/or the user interface input) received in response to the prompt can then be utilized to resolve the request.

    DETERMINING AGENTS FOR PERFORMING ACTIONS BASED AT LEAST IN PART ON IMAGE DATA

    公开(公告)号:US20180336045A1

    公开(公告)日:2018-11-22

    申请号:US15603092

    申请日:2017-05-23

    Applicant: Google Inc.

    Inventor: Ibrahim Badr

    Abstract: An assistant is described that selects, based at least in part on image data received from a camera of a computing device, a recommended agent from a plurality of agents to perform one or more actions associated with the image data. The assistant determines whether to recommend that the assistant or the recommended agent perform the one or more actions associated with the image data and responsive to determining to recommend that the recommended agent perform the one or more actions associated with the image data, outputs an indication of the recommended agent. Responsive to receiving the user input confirming the recommended agent, the assistant causes the recommended agent to at least initiate performance of the one or more actions associated with the image data.

Patent Agency Ranking