公开(公告)号：US20170339090A1

公开(公告)日：2017-11-23

申请号：US15672256

申请日：2017-08-08

Applicant: Google Inc.

Inventor： Matthew Sharifi ,  Jakob Nicolaus Foerster

IPC: H04L12/58 ,  G08B5/22

CPC classification number: H04L51/24 ,  G06F9/542 ,  G08B5/222

Abstract: In some examples, a method includes receiving, first notification data from a first application and second notification data from a second application. The method may include generating, based at least in part on comparing the first notification data to the second notification data, an affinity score that indicates whether content from the first notification data has a relationship to at least a portion of content from the second notification data. The method may include, generating a bundle notification graphical element that includes at least a portion of the content from the first notification data and a graphical indicator that indicates the content from the first and second notification data are related. The method may include outputting a set of notification graphical elements comprising the bundle notification graphical element accompanied by the graphical indicator.

公开(公告)号：US09824079B1

公开(公告)日：2017-11-21

申请号：US14451385

申请日：2014-08-04

Applicant: GOOGLE INC.

Inventor： Matthew Sharifi ,  David Petrou

IPC: G06F17/21 ,  G06F17/24 ,  G06F17/22

CPC classification number: G06F17/30259 ,  G06F3/04842 ,  G06F3/04845 ,  G06F9/451 ,  G06F17/2235 ,  G06F17/241 ,  G06F17/278 ,  G06F17/30112 ,  G06F17/30247 ,  G06F17/30268 ,  G06F17/30321 ,  G06F17/3053 ,  G06F17/30899 ,  G06K9/00469 ,  G06K9/6215 ,  G06Q10/1097 ,  H04L67/06 ,  H04W4/18

Abstract: Systems and methods identify actionable content in onscreen content and provide at least a default action for the content. For example, a method may include receiving an image of a screen captured from a display of a mobile device, determining areas of actionable content in the image, and determining a respective action for each area of actionable content. The method may also include generating annotation data for the image, the annotation data including a visual cue that corresponds to a first area of actionable content, the visual cue being actionable to initiate the respective action when selected and providing the annotation data for display on the mobile device.

公开(公告)号：US20170330336A1

公开(公告)日：2017-11-16

申请号：US15154957

申请日：2016-05-14

Applicant: Google Inc.

Inventor： Dominik Roblek ,  David Petrou ,  Matthew Sharifi

IPC: G06T7/30 ,  G06F3/0484 ,  G06F3/0488 ,  G06T7/90

CPC classification number: G06T7/30 ,  G06F3/04842 ,  G06F3/0488 ,  G06F17/30047 ,  G06F17/30867 ,  G06T7/90

Abstract: Methods and apparatus directed to segmenting content displayed on a computing device into regions. The segmenting of content displayed on the computing device into regions is accomplished via analysis of pixels of a “screenshot image” that captures at least a portion of (e.g., all of) the displayed content. Individual pixels of the screenshot image may be analyzed to determine one or more regions of the screenshot image and to optionally assign a corresponding semantic type to each of the regions. Some implementations are further directed to generating, based on one or more of the regions, interactive content to provide for presentation to the user via the computing device.

公开(公告)号：US09811352B1

公开(公告)日：2017-11-07

申请号：US14451401

申请日：2014-08-04

Applicant: GOOGLE INC.

Inventor： Matthew Sharifi ,  David Petrou

IPC: G06F17/30 ,  G06F9/44 ,  G06F3/0484

CPC classification number: G06F17/30259 ,  G06F3/04842 ,  G06F3/04845 ,  G06F9/451 ,  G06F17/2235 ,  G06F17/241 ,  G06F17/278 ,  G06F17/30112 ,  G06F17/30247 ,  G06F17/30268 ,  G06F17/30321 ,  G06F17/3053 ,  G06F17/30899 ,  G06K9/00469 ,  G06K9/6215 ,  G06Q10/1097 ,  H04L67/06 ,  H04W4/18

Abstract: Systems and methods are provided for automating user input using onscreen content. For example, a method includes receiving a selection of a first image representing a previously captured screen of a mobile device, the first image having a corresponding timestamp, determining a set of stored user input actions that occur prior to the timestamp corresponding to the first image and after a timestamp corresponding to a reference image, the reference image representing another previously captured screen of the mobile device, and providing a user interface element configured to, when selected, initiate a replaying of the set of user input actions on the mobile device, starting from a state corresponding to the reference image.

公开(公告)号：US20170310616A1

公开(公告)日：2017-10-26

申请号：US15133291

申请日：2016-04-20

Applicant: Google Inc.

Inventor： Jing Cao ,  Alexa Greenberg ,  Abhanshu Sharma ,  Yanchao Su ,  Nicholas Kong ,  Muhammad Mohsin ,  Jacek Jurewicz ,  Wei Huang ,  Matthew Sharifi ,  Benjamin Sidhom

IPC: H04L12/58 ,  G06F17/30 ,  G06F3/0488

CPC classification number: H04L51/046 ,  G06F3/0237 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04886 ,  G06F17/30398 ,  G06F17/30554 ,  G06F17/30643 ,  G06F17/30864 ,  G06F17/30867 ,  G06F17/30973

Abstract: A computing device is described that includes at least one processor and a memory including instructions that when executed cause the at least one processor to output, for display, a graphical keyboard comprising a plurality of keys, and determine, based on an indication of a selection of one or more keys from the plurality of keys, text of an electronic communication. The instructions, when executed, further cause the at least one processor to identify, based at least in part on the text, a searchable entity or trigger phrase, generate, based on the searchable entity or trigger phrase, a search query, and output, for display, within the graphical keyboard, a graphical indication to indicate that the computing device generated the search query.

公开(公告)号：US09798708B1

公开(公告)日：2017-10-24

申请号：US14451389

申请日：2014-08-04

Applicant: GOOGLE INC.

Inventor： Matthew Sharifi ,  David Petrou

IPC: G06F17/21 ,  G06F17/24

CPC classification number: G06F17/30259 ,  G06F3/04842 ,  G06F3/04845 ,  G06F9/451 ,  G06F17/2235 ,  G06F17/241 ,  G06F17/278 ,  G06F17/30112 ,  G06F17/30247 ,  G06F17/30268 ,  G06F17/30321 ,  G06F17/3053 ,  G06F17/30899 ,  G06K9/00469 ,  G06K9/6215 ,  G06Q10/1097 ,  H04L67/06 ,  H04W4/18

Abstract: Systems and methods are provided for highlighting relevant mobile onscreen content. For example, a mobile device can include memory storing instructions that, when executed by at least one processor, cause the mobile device to perform operations including capturing an image of a screen on the mobile device, the screen being displayed on a display of the mobile device, and providing the image to a server. The operations may also include receiving annotation data from the server, the annotation data including a visual cue that corresponds to a portion of the image that includes an entry in a list, the entry being associated with an entity in a graph-based data store relevant to a user of the mobile device, and display the annotation data with a second screen being displayed on the displaying of the mobile device so that the visual cue aligns with the entry in the second screen.

公开(公告)号：US09786279B2

公开(公告)日：2017-10-10

申请号：US15410180

申请日：2017-01-19

Applicant: Google Inc.

Inventor： Matthew Sharifi ,  Gheorghe Postelnicu

IPC: G10L15/00 ,  G10L17/00 ,  G10L21/00 ,  G10L25/00 ,  G10L15/22 ,  G10L15/08 ,  G10L15/24 ,  G10L15/30 ,  G06F17/30

CPC classification number: G10L15/22 ,  G06F17/30026 ,  G06F17/30654 ,  G06F17/30684 ,  G06F17/30752 ,  G10L15/08 ,  G10L15/1815 ,  G10L15/24 ,  G10L15/30 ,  G10L2015/088 ,  G10L2015/223 ,  G10L2015/225

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving audio data encoding an utterance and environmental data, obtaining a transcription of the utterance, identifying an entity using the environmental data, submitting a query to a natural language query processing engine, wherein the query includes at least a portion of the transcription and data that identifies the entity, and obtaining one or more results of the query.

公开(公告)号：US09756005B2

公开(公告)日：2017-09-05

申请号：US14932915

申请日：2015-11-04

Applicant: Google Inc.

Inventor： Matthew Sharifi ,  Jakob Nicolaus Foerster

IPC: G08B23/00 ,  H04L12/58 ,  G08B5/22

CPC classification number: H04L51/24 ,  G06F9/542 ,  G08B5/222

Abstract: In some examples, a method includes receiving, first notification data from a first application and second notification data from a second application. The method may include generating, based at least in part on comparing the first notification data to the second notification data, an affinity score that indicates whether content from the first notification data has a relationship to at least a portion of content from the second notification data. The method may include, generating a bundle notification graphical element that includes at least a portion of the content from the first notification data and a graphical indicator that indicates the content from the first and second notification data are related. The method may include outputting a set of notification graphical elements comprising the bundle notification graphical element accompanied by the graphical indicator.

公开(公告)号：US09704483B2

公开(公告)日：2017-07-11

申请号：US14811190

申请日：2015-07-28

Applicant: Google Inc.

Inventor： Matthew Sharifi ,  Jakob Nicolaus Foerster

IPC: G06F17/27 ,  G10L15/197 ,  G10L15/22

CPC classification number: G10L15/197 ,  G06F17/277 ,  G06F17/2785 ,  G10L2015/227

Abstract: Methods, including computer programs encoded on a computer storage medium, for collaborative language model biasing. In one aspect, a method includes receiving (i) data including a set of terms associated with a target user, and, (ii) from each of multiple other users, data including a set of terms associated with the other user, selecting a particular other user based at least on comparing the set of terms associated with the target user to the sets of terms associated with the other users, selecting one or more terms from the set of terms that is associated with the particular other user, obtaining, based on the selected terms that are associated with the particular other user, a biased language model, and providing the biased language model to an automated speech recognizer.

公开(公告)号：US09661361B2

公开(公告)日：2017-05-23

申请号：US13623031

申请日：2012-09-19

Applicant: Google Inc.

Inventor： Matthew Sharifi

IPC: H04H60/32 ,  H04N21/235 ,  H04N21/234 ,  H04N21/25 ,  H04N21/466 ,  H04N21/84

CPC classification number: H04N21/2353 ,  H04N21/23418 ,  H04N21/251 ,  H04N21/4668 ,  H04N21/84

Abstract: Systems and methods for matching live media content are disclosed. At a server, obtaining first media content from a client device, herein the first media content corresponds to a portion of media content being played on the client device, and the first media content is associated with a predefined expiration time; obtaining second media content from one or more content feeds, wherein the second media content also corresponds to a portion of the media content being played on the client device; in accordance with a determination that the second media content corresponds to a portion of the media content that has been played on the client device: before the predefined expiration time, obtaining third media content corresponding to the media content being played on the client device, from the one or more content feeds; and comparing the first media content with the third media content.