Material capture using imaging
    1.
    发明授权

    公开(公告)号:US10181199B2

    公开(公告)日:2019-01-15

    申请号:US15589757

    申请日:2017-05-08

    Abstract: Methods and systems are provided for performing material capture to determine properties of an imaged surface. A plurality of images can be received depicting a material surface. The plurality of images can be calibrated to align corresponding pixels of the images and determine reflectance information for at least a portion of the aligned pixels. After calibration, a set of reference materials from a material library can be selected using the calibrated images. The set of reference materials can be used to determine a material model that accurately represents properties of the material surface.

    3-Dimensional Portrait Reconstruction From a Single Photo
    3.
    发明申请
    3-Dimensional Portrait Reconstruction From a Single Photo 有权
    从单张照片三维人像重建

    公开(公告)号:US20160314619A1

    公开(公告)日:2016-10-27

    申请号:US14695727

    申请日:2015-04-24

    Abstract: Systems and methods are disclosed herein for 3-Dimensional portrait reconstruction from a single photo. A face portion of a person depicted in a portrait photo is detected and a 3-Dimensional model of the person depicted in the portrait photo constructed. In one embodiment, constructing the 3-Dimensional model involves fitting hair portions of the portrait photo to one or more helices. In another embodiment, constructing the 3-Dimensional model involves applying positional and normal boundary conditions determined based on one or more relationships between face portion shape and hair portion shape. In yet another embodiment, constructing the 3-Dimensional model involves using shape from shading to capture fine-scale details in a form of surface normals, the shape from shading based on an adaptive albedo model and/or a lighting condition estimated based on shape fitting the face portion.

    Abstract translation: 本文公开了用于从单张照片进行三维人像重构的系统和方法。 检测肖像照片中描绘的人的面部部分,并且构建在肖像照片中描绘的人的三维模型。 在一个实施例中,构建三维模型涉及将肖像照片的头发部分适合于一个或多个螺旋。 在另一个实施例中,构造三维模型包括应用基于面部部分形状和头发部分形状之间的一个或多个关系确定的位置和正常边界条件。 在另一个实施例中,构造三维模型涉及使用阴影的形状来以表面法线的形式捕获精细尺度的细节,基于自适应反照率模型的阴影形状和/或基于形状拟合估计的照明条件 面部分。

    AUTOMATIC GEOMETRY AND LIGHTING INFERENCE FOR REALISTIC IMAGE EDITING

    公开(公告)号:US20160171755A1

    公开(公告)日:2016-06-16

    申请号:US15053156

    申请日:2016-02-25

    Abstract: Image editing techniques are disclosed that support a number of physically-based image editing tasks, including object insertion and relighting. The techniques can be implemented, for example in an image editing application that is executable on a computing system. In one such embodiment, the editing application is configured to compute a scene from a single image, by automatically estimating dense depth and diffuse reflectance, which respectively form the geometry and surface materials of the scene. Sources of illumination are then inferred, conditioned on the estimated scene geometry and surface materials and without any user input, to form a complete 3D physical scene model corresponding to the image. The scene model may include estimates of the geometry, illumination, and material properties represented in the scene, and various camera parameters. Using this scene model, objects can be readily inserted and composited into the input image with realistic lighting, shadowing, and perspective.

    Depth estimation using three-dimensional epipolar data structures
    5.
    发明授权
    Depth estimation using three-dimensional epipolar data structures 有权
    使用三维对极数据结构的深度估计

    公开(公告)号:US09240048B2

    公开(公告)日:2016-01-19

    申请号:US13690514

    申请日:2012-11-30

    CPC classification number: G06T7/0065 G06T7/557

    Abstract: Systems and methods are provided for depth map estimation using three-dimensional epipolar data structures. The image manipulation application receives image data depicting an image space from a multiple perspectives. The image manipulation application generates at least one three-dimensional epipolar data structure from the image data. The at least one three-dimensional epipolar data structure includes data describing the difference in position of at least one object between the perspectives. The at least one three-dimensional epipolar data structure corresponds to at least one region of the image space. The image manipulation application generates a depth map based on the at least one three-dimensional epipolar data structure.

    Abstract translation: 提供了使用三维对极数据结构进行深度图估计的系统和方法。 图像处理应用从多个视角接收描绘图像空间的图像数据。 图像处理应用从图像数据生成至少一个三维对极数据结构。 所述至少一个三维对极数据结构包括描述在透视图之间的至少一个对象的位置差异的数据。 所述至少一个三维对极数据结构对应于图像空间的至少一个区域。 所述图像处理应用基于所述至少一个三维对极数据结构生成深度图。

    Depth Estimation Using Three-Dimensional Epipolar Data Structures
    6.
    发明申请
    Depth Estimation Using Three-Dimensional Epipolar Data Structures 有权
    使用三维极值数据结构的深度估计

    公开(公告)号:US20140152647A1

    公开(公告)日:2014-06-05

    申请号:US13690514

    申请日:2012-11-30

    CPC classification number: G06T7/0065 G06T7/557

    Abstract: Systems and methods are provided for depth map estimation using three-dimensional epipolar data structures. The image manipulation application receives image data depicting an image space from a multiple perspectives. The image manipulation application generates at least one three-dimensional epipolar data structure from the image data. The at least one three-dimensional epipolar data structure includes data describing the difference in position of at least one object between the perspectives. The at least one three-dimensional epipolar data structure corresponds to at least one region of the image space. The image manipulation application generates a depth map based on the at least one three-dimensional epipolar data structure.

    Abstract translation: 提供了使用三维对极数据结构进行深度图估计的系统和方法。 图像处理应用从多个视角接收描绘图像空间的图像数据。 图像处理应用从图像数据生成至少一个三维对极数据结构。 所述至少一个三维对极数据结构包括描述在透视图之间的至少一个对象的位置差异的数据。 所述至少一个三维对极数据结构对应于图像空间的至少一个区域。 所述图像处理应用基于所述至少一个三维对极数据结构生成深度图。

    Local white balance under mixed illumination using flash photography

    公开(公告)号:US10070111B2

    公开(公告)日:2018-09-04

    申请号:US14978605

    申请日:2015-12-22

    Abstract: Embodiments of the present invention facilitate automatically white-balancing images captured under mixed lighting conditions. More particularly, some embodiments are directed to leveraging flash photography to capture two images in quick succession, one with the flash activated and one without. By combining these two images, a per-pixel white balance kernel can be automatically determined and used to generate a white-balanced image without requiring any user input or user assumptions about the lighting in the scene. In embodiments, the white balance kernels for pixels that lie in the shadow or appear as specular spots are masked and can be interpolated from the white balance kernels at unmasked kernels. Motion effects between the flash and non-flash images may also be reduced.

    IMAGE LIGHTING TRANSFER VIA MULTI-DIMENSIONAL HISTOGRAM MATCHING

    公开(公告)号:US20180061028A1

    公开(公告)日:2018-03-01

    申请号:US15253655

    申请日:2016-08-31

    CPC classification number: G06T5/50 G06T11/00 G06T2207/10024

    Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed at relighting a target image based on a lighting effect from a reference image. In one embodiment, a target image and a reference image are received, the reference image includes a lighting effect desired to be applied to the target image. A lighting transfer is performed using color data and geometrical data associated with the reference image and color data and geometrical data associated with the target image. The lighting transfer causes generation of a relit image that corresponds with the target image having a lighting effect of the reference image. The relit image is provided for display to a user via one or more output devices. Other embodiments may be described and/or claimed.

Patent Agency Ranking