NEURAL RERENDERING FROM 3D MODELS
    12.
    发明申请

    公开(公告)号:US20200320777A1

    公开(公告)日:2020-10-08

    申请号:US16837612

    申请日:2020-04-01

    Applicant: Google LLC

    Abstract: According to an aspect, a method for neural rerendering includes obtaining a three-dimensional (3D) model representing a scene of a physical space, where the 3D model is constructed from a collection of input images, rendering an image data buffer from the 3D model according to a viewpoint, where the image data buffer represents a reconstructed image from the 3D model, receiving, by a neural rerendering network, the image data buffer, receiving, by the neural rerendering network, an appearance code representing an appearance condition, and transforming, by the neural rerendering network, the image data buffer into a rerendered image with the viewpoint of the image data buffer and the appearance condition specified by the appearance code.

    SMOOTHED NORMALS FROM DEPTH MAPS FOR NORMAL-BASED TEXTURE BLENDING

    公开(公告)号:US20200160585A1

    公开(公告)日:2020-05-21

    申请号:US16321962

    申请日:2018-11-15

    Applicant: GOOGLE LLC

    Inventor: Daniel Goldman

    Abstract: Techniques of smoothing surface normals in a texture mapping application involve generating smoothed normals from the perspective of each camera using to capture images for texture mapping. Along these lines, a camera used to capture an image for texture mapping is situated at an orientation relative to the geometrical object onto which a texture mapping computer maps the texture image. The texture mapping computer places a filter window centered at a point on the geometrical object. The texture mapping computer then generates, as the smoothed normal at that point, an average normal over points in the filter window. The average normals thus computed for each camera are then used in the weights of the weighted average that is the image value at that point.

    FEW-SHOT SYNTHESIS OF TALKING HEADS

    公开(公告)号:US20220130111A1

    公开(公告)日:2022-04-28

    申请号:US17310678

    申请日:2020-10-28

    Applicant: Google LLC

    Abstract: Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of input images of a user, generating a three-dimensional mesh proxy based on a first set of features extracted from the plurality of input images and a second set of features extracted from the plurality of input images. The method may further include generating a neural texture based on a three-dimensional mesh proxy and the plurality of input images, generating a representation of the user including at least a neural texture, and sampling at least one portion of the neural texture from the three-dimensional mesh proxy. In response to providing the at least one sampled portion to a neural renderer, the method may include receiving, from the neural renderer, a synthesized image of the user that is previously not captured by the image processing system.

    Smoothed normals from depth maps for normal-based texture blending

    公开(公告)号:US11227426B2

    公开(公告)日:2022-01-18

    申请号:US16321962

    申请日:2018-11-15

    Applicant: GOOGLE LLC

    Inventor: Daniel Goldman

    Abstract: Techniques of smoothing surface normals in a texture mapping application involve generating smoothed normals from the perspective of each camera using to capture images for texture mapping. Along these lines, a camera used to capture an image for texture mapping is situated at an orientation relative to the geometrical object onto which a texture mapping computer maps the texture image. The texture mapping computer places a filter window centered at a point on the geometrical object. The texture mapping computer then generates, as the smoothed normal at that point, an average normal over points in the filter window. The average normals thus computed for each camera are then used in the weights of the weighted average that is the image value at that point.

Patent Agency Ranking