公开(公告)号：US10963630B1

公开(公告)日：2021-03-30

申请号：US16666976

申请日：2019-10-29

Applicant: Google LLC

Inventor： Matthew Sharifi ,  David Petrou

IPC: G06F40/169 ,  G06F3/0484 ,  H04L29/08

Abstract: Systems and methods are provided for sharing a screen from a mobile device. For example, a method includes receiving, at a second mobile device, an image of a screen captured from a first mobile device and determining whether to trigger an automated action. The method may also include displaying, responsive to not triggering the automated action, annotation data generated for the image with the image on a display of the second mobile device, the annotation data including at least one visual cue corresponding to content in the image relevant to a user of the second mobile device. The method may further include, responsive to triggering the automated action, determining that a mobile application associated with the image is installed on the second mobile device and replaying user input actions received with the image on the second mobile device starting from a reference screen associated with the mobile application.

公开(公告)号：US20200288063A1

公开(公告)日：2020-09-10

申请号：US16881816

申请日：2020-05-22

Applicant: Google LLC

Inventor： Teresa Ko ,  Hartwig Adam ,  Mikkel Crone Koser ,  Alexei Masterov ,  Andrews-Junior Kimbembe ,  Matthew J. Bridges ,  Paul Chang ,  David Petrou ,  Adam Berenzweig

IPC: H04N5/232 ,  G06K9/00 ,  G06F3/14 ,  G09G5/36 ,  G06K9/78 ,  G06F3/0481 ,  G06F3/0484

Abstract: Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder

公开(公告)号：US20200285670A1

公开(公告)日：2020-09-10

申请号：US16881964

申请日：2020-05-22

Applicant: Google LLC

Inventor： Abhanshu Sharma ,  David Petrou ,  Matthew Sharifi

IPC: G06F16/58 ,  G06F16/903 ,  G06F3/0484 ,  G06F3/0488

Abstract: Methods, systems, and apparatus for receiving a query image and a user tap location, processing the received query image based on the user tap location, identifying one or more entities associated with the processed query image and in response to receiving (i) the query image, and (ii) the user tap location, providing information about the identified one or more of the entities.

公开(公告)号：US20200050610A1

公开(公告)日：2020-02-13

申请号：US16657467

申请日：2019-10-18

Applicant: Google LLC

Inventor： Matthew Sharifi ,  David Petrou ,  Abhanshu Sharma

IPC: G06F16/2457 ,  G06F16/583 ,  G06F16/58 ,  G06F16/2452 ,  G06F16/903

Abstract: Methods, systems, and apparatus for receiving a query image, receiving one or more entities that are associated with the query image, identifying, for one or more of the entities, one or more candidate search queries that are pre-associated with the one or more entities, generating a respective relevance score for each of the candidate search queries, selecting, as a representative search query for the query image, a particular candidate search query based at least on the generated respective relevance scores and providing the representative search query for output in response to receiving the query image.

公开(公告)号：US10534808B2

公开(公告)日：2020-01-14

申请号：US14183001

申请日：2014-02-18

Applicant: GOOGLE LLC

Inventor： David Petrou

IPC: G06F17/30 ,  G06F16/532 ,  G06F16/583

Abstract: A visual query such as a photograph, a screen shot, a scanned image, a video frame, or an image created by a content authoring application is submitted to a visual query search system. The search system processes the visual query by sending it to a plurality of parallel search systems, each implementing a distinct visual query search process. These parallel search systems may include but are not limited to optical character recognition (OCR), facial recognition, product recognition, bar code recognition, object-or-object-category recognition, named entity recognition, and color recognition. Then at least one search result is sent to the client system. In some embodiments, when the visual query is an image containing a text element and a non-text element, at least one search result includes an optical character recognition result for the text element and at least one image-match result for the non-text element.

公开(公告)号：US10440279B2

公开(公告)日：2019-10-08

申请号：US15946342

申请日：2018-04-05

Applicant: Google LLC

Inventor： Teresa Ko ,  Hartwig Adam ,  Mikkel Crone Koser ,  Alexei Masterov ,  Andrews-Junior Kimbembe ,  Matthew J. Bridges ,  Paul Chang ,  David Petrou ,  Adam Berenzweig

IPC: H04N5/232 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/14 ,  G06F8/34 ,  G06K9/00 ,  G09G5/36 ,  G06K9/78

Abstract: Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder.

公开(公告)号：US12051092B2

公开(公告)日：2024-07-30

申请号：US18124174

申请日：2023-03-21

Applicant: GOOGLE LLC

Inventor： Keith Bonawitz ,  Daniel Ramage ,  David Petrou

IPC: G06Q30/0251 ,  G06N5/025 ,  H04L9/00 ,  H04L9/40

CPC classification number: G06Q30/0269 ,  G06N5/025 ,  G06Q30/0251 ,  G06Q30/0261 ,  H04L9/008 ,  H04L63/0428

Abstract: Systems and methods are shown for providing private local sponsored content selection and improving intelligence models through distribution among mobile devices. This allows greater data gathering capabilities through the use of the sensors of the mobile devices as well as data stored on data storage components of the mobile devices to create predicted models while offering better opportunities to preserve privacy. Locally stored profiles comprising machine intelligence models may also be used to determine the relevance of the data gathered and in improving an aggregated model for identifying the relevance of data and the selection of sponsored content items. Distributed optimization is used in conjunction with privacy techniques to create the improved machine intelligence models. Publishers may also benefit from the improved privacy by protecting the statistics of type or volume of sponsored content items shown with publisher content.

公开(公告)号：US20240233683A1

公开(公告)日：2024-07-11

申请号：US18614812

申请日：2024-03-25

Applicant: Google LLC

Inventor： Teresa Ko ,  Hartwig Adam ,  Mikkel Crone Koser ,  Alexei Masterov ,  Andrews-Junior Kimbembe ,  Matthew J. Bridges ,  Paul Chang ,  David Petrou ,  Adam Berenzweig

IPC: G09G5/36 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/14 ,  G06V10/10 ,  G06V20/20 ,  G06V20/30 ,  G06V20/70 ,  H04N23/62 ,  H04N23/63

CPC classification number: G09G5/363 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/1431 ,  G06F3/1438 ,  G06V10/10 ,  G06V20/20 ,  G06V20/30 ,  G06V20/70 ,  H04N23/62 ,  H04N23/63 ,  H04N23/631 ,  G09G2360/08

Abstract: Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder.

公开(公告)号：US20240104135A1

公开(公告)日：2024-03-28

申请号：US18531144

申请日：2023-12-06

Applicant: Google LLC

Inventor： David Petrou ,  Matthew Bridges ,  Shailesh Nalawadi ,  Hartwig Adam ,  Matthew R. Casey ,  Hartmut Neven ,  Andrew Harp

IPC: G06F16/535 ,  G06F3/048 ,  G06F16/50 ,  G06F16/583 ,  G06F16/9535 ,  G06F16/9538 ,  G06F18/2413 ,  G06V10/10 ,  G06V10/56 ,  G06V10/96 ,  G06V20/20 ,  G06V20/62 ,  G06V30/142 ,  G06V30/19 ,  H04N23/00

CPC classification number: G06F16/535 ,  G06F3/048 ,  G06F16/50 ,  G06F16/5838 ,  G06F16/5846 ,  G06F16/9535 ,  G06F16/9538 ,  G06F18/24133 ,  G06V10/10 ,  G06V10/56 ,  G06V10/96 ,  G06V20/20 ,  G06V20/63 ,  G06V30/142 ,  G06V30/19173 ,  H04N23/00

Abstract: A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

公开(公告)号：US20230379678A1

公开(公告)日：2023-11-23

申请号：US18227751

申请日：2023-07-28

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Jorge Pereira ,  Dominik Roblek ,  Julian Odell ,  Cong Li ,  David Petrou

IPC: H04W4/60 ,  G06F16/248 ,  G06F16/9535 ,  G06F16/2457 ,  H04W4/029 ,  G06F16/907 ,  G06F16/587 ,  G06V20/62 ,  H04L67/50 ,  H04W4/18 ,  G06F16/23

CPC classification number: H04W4/60 ,  G06F16/248 ,  G06F16/9535 ,  G06F16/24578 ,  H04W4/029 ,  G06F16/907 ,  G06F16/587 ,  G06V20/62 ,  H04L67/535 ,  H04W4/18 ,  G06F16/23 ,  G06F16/235 ,  G06F16/2358

Abstract: Systems and methods are provided for a personalized entity repository. For example, a computing device comprises a personalized entity repository having fixed sets of entities from an entity repository stored at a server, a processor, and memory storing instructions that cause the computing device to identify fixed sets of entities that are relevant to a user based on context associated with the computing device, rank the fixed sets by relevancy, and update the personalized entity repository using selected sets determined based on the rank and on set usage parameters applicable to the user. In another example, a method includes generating fixed sets of entities from an entity repository, including location-based sets and topic-based sets, and providing a subset of the fixed sets to a client, the client requesting the subset based on the client's location and on items identified in content generated for display on the client.