Photorealistic Text Inpainting for Augmented Reality Using Generative Models

    公开(公告)号:US20240104312A1

    公开(公告)日:2024-03-28

    申请号:US17953710

    申请日:2022-09-27

    Applicant: Google LLC

    CPC classification number: G06F40/58 G06N3/0454 G06T19/006

    Abstract: Provided are systems and methods that use generative models (e.g., generative adversarial networks) to enable photorealistic text inpainting in augmented reality. One example application of the proposed systems is to perform augmented reality translation. For example, a user can operate an image capture device (e.g., camera, smartphone, etc.) to capture imagery of a real-world scene that includes real-world text (e.g., signage, restaurant menus, etc.). The real-world text can be translated into a different language. Further, the captured imagery can be processed with a machine-learned generative model to produce an augmented image. The augmented image can depict the real-world scene with the real-world text removed. Specifically, because a machine-learned generative model is used, the augmented image can appear significantly more realistic, for example versus an image in which the real-world text has simply been blocked using a box with a single color.

    REAL TIME OBJECT DETECTION AND TRACKING
    4.
    发明申请

    公开(公告)号:US20200265229A1

    公开(公告)日:2020-08-20

    申请号:US16347484

    申请日:2018-05-07

    Applicant: Google LLC

    Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.

    Real Time Object Detection and Tracking

    公开(公告)号:US20240404277A1

    公开(公告)日:2024-12-05

    申请号:US18801217

    申请日:2024-08-12

    Applicant: Google LLC

    Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.

    Real Time Object Detection and Tracking
    6.
    发明公开

    公开(公告)号:US20230222792A1

    公开(公告)日:2023-07-13

    申请号:US18188005

    申请日:2023-03-22

    Applicant: Google LLC

    CPC classification number: G06V20/50 H04N23/61 H04N23/633 G06V10/764

    Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.

Patent Agency Ranking