公开(公告)号：US20240104135A1

公开(公告)日：2024-03-28

申请号：US18531144

申请日：2023-12-06

Applicant: Google LLC

Inventor： David Petrou ,  Matthew Bridges ,  Shailesh Nalawadi ,  Hartwig Adam ,  Matthew R. Casey ,  Hartmut Neven ,  Andrew Harp

IPC: G06F16/535 ,  G06F3/048 ,  G06F16/50 ,  G06F16/583 ,  G06F16/9535 ,  G06F16/9538 ,  G06F18/2413 ,  G06V10/10 ,  G06V10/56 ,  G06V10/96 ,  G06V20/20 ,  G06V20/62 ,  G06V30/142 ,  G06V30/19 ,  H04N23/00

CPC classification number: G06F16/535 ,  G06F3/048 ,  G06F16/50 ,  G06F16/5838 ,  G06F16/5846 ,  G06F16/9535 ,  G06F16/9538 ,  G06F18/24133 ,  G06V10/10 ,  G06V10/56 ,  G06V10/96 ,  G06V20/20 ,  G06V20/63 ,  G06V30/142 ,  G06V30/19173 ,  H04N23/00

Abstract: A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

公开(公告)号：US20230237090A1

公开(公告)日：2023-07-27

申请号：US18189776

申请日：2023-03-24

Applicant: Google LLC

Inventor： David Petrou ,  Matthew Bridges ,  Shailesh Nalawadi ,  Hartwig Adam ,  Matthew R. Casey ,  Hartmut Neven ,  Andrew Harp

IPC: G06F16/583 ,  G06F16/50 ,  G06F16/9535 ,  G06V10/10 ,  G06V10/56 ,  G06V10/96 ,  G06V20/20 ,  G06V20/62 ,  G06V30/142 ,  G06F18/2413 ,  H04N23/00 ,  G06V30/19 ,  G06F3/048

CPC classification number: G06F16/5838 ,  G06F3/048 ,  G06F16/50 ,  G06F16/5846 ,  G06F16/9535 ,  G06F18/24133 ,  G06V10/10 ,  G06V10/56 ,  G06V10/96 ,  G06V20/20 ,  G06V20/63 ,  G06V30/142 ,  G06V30/19173 ,  H04N23/00

Abstract: A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

公开(公告)号：US11570365B2

公开(公告)日：2023-01-31

申请号：US17340868

申请日：2021-06-07

Applicant: Google LLC

Inventor： Teresa Ko ,  Hartwig Adam ,  Mikkel Crone Koser ,  Alexei Masterov ,  Andrews-Junior Kimbembe ,  Matthew J. Bridges ,  Paul Chang ,  David Petrou ,  Adam Berenzweig

IPC: H04N5/232 ,  G06F3/14 ,  G06F3/048 ,  G09G5/36 ,  G06V10/10 ,  G06V20/20 ,  G06V20/30 ,  G06F3/04817 ,  G06F3/04842

Abstract: Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder.

公开(公告)号：US20210141827A1

公开(公告)日：2021-05-13

申请号：US17157022

申请日：2021-01-25

Applicant: Google LLC

Inventor： David Petrou ,  Matthew J. Bridges ,  Shailesh Nalawadi ,  Hartwig Adam ,  Matthew R. Casey ,  Hartmut Neven ,  Andrew Harp

IPC: G06F16/583 ,  G06F16/50 ,  G06F16/9535 ,  G06K9/78 ,  H04N5/225 ,  G06K9/00 ,  G06K9/22 ,  G06K9/32 ,  G06K9/46 ,  G06K9/62 ,  G06F3/048

Abstract: A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

公开(公告)号：US10902055B2

公开(公告)日：2021-01-26

申请号：US16744998

申请日：2020-01-16

Applicant: Google LLC

Inventor： David Petrou ,  Matthew J. Bridges ,  Shailesh Nalawadi ,  Hartwig Adam ,  Matthew R. Casey ,  Hartmut Neven ,  Andrew Harp

IPC: G06F16/583 ,  G06F16/50 ,  G06F16/9535 ,  G06K9/78 ,  H04N5/225 ,  G06K9/00 ,  G06K9/22 ,  G06K9/32 ,  G06K9/46 ,  G06K9/62 ,  G06F3/048

Abstract: A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

公开(公告)号：US20190340194A1

公开(公告)日：2019-11-07

申请号：US16511522

申请日：2019-07-15

Applicant: Google LLC

Inventor： Ming Zhao ,  Yang Song ,  Hartwig Adam ,  Ullas Gargi ,  Yushi Jing ,  Henry Allan Rowley

IPC: G06F16/438 ,  G06F16/783 ,  G06F16/951 ,  G06F16/435 ,  G06F17/10 ,  G06K9/00 ,  G06K9/62 ,  G06F16/41

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for associating still images and videos. One method includes receiving a plurality of images and a plurality of videos and determining whether the images are related to the videos. The determining includes, for an image and a video, extracting features from the image and extracting features frames of the video, and comparing the features to determine whether the image is related to the video. The method further includes maintaining a data store storing data associating each image with each video determined to be related to the image.

公开(公告)号：US10198457B2

公开(公告)日：2019-02-05

申请号：US15247542

申请日：2016-08-25

Applicant: Google LLC

Inventor： David Petrou ,  Matthew J. Bridges ,  Shailesh Nalawadi ,  Hartwig Adam ,  Matthew R. Casey ,  Hartmut Neven ,  Andrew Harp

IPC: G06K9/32 ,  G06F17/30 ,  G06F3/048 ,  G06K9/78 ,  H04N5/225 ,  G06K9/00 ,  G06K9/22 ,  G06K9/46 ,  G06K9/62

Abstract: A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

公开(公告)号：US10031927B2

公开(公告)日：2018-07-24

申请号：US14929958

申请日：2015-11-02

Applicant: Google LLC

Inventor： David Petrou ,  Andrew Rabinovich ,  Hartwig Adam

IPC: G06K9/00 ,  G06F17/30 ,  G06F17/00

Abstract: A facial recognition search system identifies one or more likely names (or other personal identifiers) corresponding to the facial image(s) in a query as follows. After receiving the visual query with one or more facial images, the system identifies images that potentially match the respective facial image in accordance with visual similarity criteria. Then one or more persons associated with the potential images are identified. For each identified person, person-specific data comprising metrics of social connectivity to the requester are retrieved from a plurality of applications such as communications applications, social networking applications, calendar applications, and collaborative applications. An ordered list of persons is then generated by ranking the identified persons in accordance with at least metrics of visual similarity between the respective facial image and the potential image matches and with the social connection metrics. Finally, at least one person identifier from the list is sent to the requester.

公开(公告)号：US10019506B1

公开(公告)日：2018-07-10

申请号：US14752410

申请日：2015-06-26

Applicant: Google LLC

Inventor： Yuan Li ,  Hartwig Adam ,  Jia Deng ,  Nan Ding

IPC: G06F17/30 ,  G06T11/20 ,  G06K9/62

CPC classification number: G06F16/285 ,  G06F16/5838 ,  G06K9/4628 ,  G06K9/6267 ,  G06K9/6892 ,  G06T11/206

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying objects in images. One of the methods includes obtaining data identifying a plurality of object categories; obtaining relationship data for the plurality of object categories; determining a plurality of valid assignments from the relationship data; obtaining, for an image, a respective raw image score for each of the object categories, wherein the raw image score for each of the object categories represents an estimate of a likelihood that the image includes an image of an object that belongs to the object category; and generating a respective final score for each of the object categories from the raw image scores using the valid assignments, wherein the final score for each of the object categories represents the likelihood that the image includes an image of an object that belongs to the object category.

公开(公告)号：US20210248179A1

公开(公告)日：2021-08-12

申请号：US17049452

申请日：2018-09-18

Applicant: Google LLC

Inventor： David Karam ,  Li Zhang ,  Ariel Gilder ,  Yuzo Watanabe ,  Eric Penner ,  Farooq Ahmad ,  Hartwig Adam

IPC: G06F16/583 ,  G06N20/00 ,  G06F16/55 ,  G06F16/535

Abstract: The present disclosure is directed to processing imagery using one or more machine learning (ML) models. In particular, data describing imagery comprising a plurality of different and distinct frames can be received; and based at least in part on one or more ML models and the data describing the imagery, and for each frame of the plurality of different and distinct frames, one or more scores can be determined for the frame. Each score of the score(s) can indicate a determined measure of suitability of the frame with respect to one or more of various different and distinct uses for which the ML model(s) are configured to determine suitability of imagery.