Texturing a three-dimensional scanned model with localized patch colors

    公开(公告)号:US09922443B2

    公开(公告)日:2018-03-20

    申请号:US15142849

    申请日:2016-04-29

    CPC classification number: G06T15/04 G06T17/00 G06T17/10 G06T2210/56

    Abstract: The disclosure describes systems and methods of selecting colors to points in a digital three-dimensional (3D) model representing a scanned object, based on points and color images associated with the 3D model. Certain embodiments involve selecting from the images a patch for each point in the 3D model, and determining a quality of the patches. The selected patches are analyzed to determine an overall score, representing aggregated quality of the patches and an aggregated smoothness indicating variation between patches selected for neighboring points. In some examples, multiple sets of selected patches are analyzed and scored, and the scores are compared to determine a representative patch set that optimizes the quality and the smoothness. Colors are assigned to the points of the digital model based on the representative set of patches.

    TEXTURING A THREE-DIMENSIONAL SCANNED MODEL WITH LOCALIZED PATCH COLORS

    公开(公告)号:US20170316597A1

    公开(公告)日:2017-11-02

    申请号:US15142849

    申请日:2016-04-29

    CPC classification number: G06T15/04 G06T17/00 G06T17/10 G06T2210/56

    Abstract: The disclosure describes systems and methods of selecting colors to points in a digital three-dimensional (3D) model representing a scanned object, based on points and color images associated with the 3D model. Certain embodiments involve selecting from the images a patch for each point in the 3D model, and determining a quality of the patches. The selected patches are analyzed to determine an overall score, representing aggregated quality of the patches and an aggregated smoothness indicating variation between patches selected for neighboring points. In some examples, multiple sets of selected patches are analyzed and scored, and the scores are compared to determine a representative patch set that optimizes the quality and the smoothness. Colors are assigned to the points of the digital model based on the representative set of patches.

    ENHANCED TEXTURE PACKING
    3.
    发明申请

    公开(公告)号:US20180075641A1

    公开(公告)日:2018-03-15

    申请号:US15263171

    申请日:2016-09-12

    CPC classification number: G06T15/04 G06T11/001

    Abstract: Embodiments of the present invention are directed towards compactly incorporating texture charts into a texture atlas. Texture charts represent three-dimensional mesh segments flattened into two-dimensional shapes. In one embodiment, a texture atlas generating engine is used to generate and evaluate compactness scores of candidate placements for a texture chart. Candidate placements generally refer to the possible locations where a texture chart can be incorporated into a texture atlas. The compactness score can be based on minimizing the distance between a texture chart being incorporated into the texture atlas and the center of mass of previously incorporated texture charts within a texture atlas. In embodiments, an infinity norm can be utilized to compute such a compactness score by outputting an average length of vectors between a texture chart being incorporated into a texture atlas and the texture atlas. Other embodiments may be described and/or claimed.

    Smoothing Images Using Machine Learning

    公开(公告)号:US20170161876A1

    公开(公告)日:2017-06-08

    申请号:US14957539

    申请日:2015-12-02

    Abstract: Smoothing images using machine learning is described. In one or more embodiments, a machine learning system is trained using multiple training items. Each training item includes a boundary shape representation and a positional indicator. To generate the training item, a smooth image is downscaled to produce a corresponding blocky image that includes multiple blocks. For a given block, the boundary shape representation encodes a blocky boundary in a neighborhood around the given block. The positional indicator reflects a distance between the given block and a smooth boundary of the smooth image. In one or more embodiments to smooth a blocky image, a boundary shape representation around a selected block is determined. The representation is encoded as a feature vector and applied to the machine learning system to obtain a positional indicator. The positional indicator is used to compute a location of a smooth boundary of a smooth image.

    Enhanced texture packing
    5.
    发明授权

    公开(公告)号:US10229525B2

    公开(公告)日:2019-03-12

    申请号:US15263171

    申请日:2016-09-12

    Abstract: Embodiments of the present invention are directed towards compactly incorporating texture charts into a texture atlas. Texture charts represent three-dimensional mesh segments flattened into two-dimensional shapes. In one embodiment, a texture atlas generating engine is used to generate and evaluate compactness scores of candidate placements for a texture chart. Candidate placements generally refer to the possible locations where a texture chart can be incorporated into a texture atlas. The compactness score can be based on minimizing the distance between a texture chart being incorporated into the texture atlas and the center of mass of previously incorporated texture charts within a texture atlas. In embodiments, an infinity norm can be utilized to compute such a compactness score by outputting an average length of vectors between a texture chart being incorporated into a texture atlas and the texture atlas. Other embodiments may be described and/or claimed.

    Recognizing combinations of body shape, pose, and clothing in three-dimensional input images

    公开(公告)号:US10163003B2

    公开(公告)日:2018-12-25

    申请号:US15392597

    申请日:2016-12-28

    Abstract: Certain embodiments involve recognizing combinations of body shape, pose, and clothing in three-dimensional input images. For example, synthetic training images are generated based on user inputs. These synthetic training images depict different training figures with respective combinations of a body pose, a body shape, and a clothing item. A machine learning algorithm is trained to recognize the pose-shape-clothing combinations in the synthetic training images and to generate feature descriptors describing the pose-shape-clothing combinations. The trained machine learning algorithm is outputted for use by an image manipulation application. In one example, an image manipulation application uses a feature descriptor, which is generated by the machine learning algorithm, to match an input figure in an input image to an example image based on a correspondence between a pose-shape-clothing combination of the input figure and a pose-shape-clothing combination of an example figure in the example image.

    GENERATING A THREE-DIMENSIONAL MODEL FROM A SCANNED OBJECT

    公开(公告)号:US20180218535A1

    公开(公告)日:2018-08-02

    申请号:US15423348

    申请日:2017-02-02

    Abstract: The present disclosure is directed toward systems and methods that facilitate scanning an object (e.g., a three-dimensional object) having custom mesh lines thereon and generating a three-dimensional mesh of the object. For example, a three-dimensional modeling system receives a scan of the object including depth information and a two-dimensional texture map of the object. The three-dimensional modeling system further generates an edge map for the two-dimensional texture map and modifies the edge map to generate a two-dimensional mesh including edges, vertices, and faces that correspond to the custom mesh lines on the object. Based on the two-dimensional mesh and the depth information from the scan, the three-dimensional modeling system generates a three-dimensional model of the object.

    Smoothing images using machine learning

    公开(公告)号:US09799102B2

    公开(公告)日:2017-10-24

    申请号:US14957539

    申请日:2015-12-02

    Abstract: Smoothing images using machine learning is described. In one or more embodiments, a machine learning system is trained using multiple training items. Each training item includes a boundary shape representation and a positional indicator. To generate the training item, a smooth image is downscaled to produce a corresponding blocky image that includes multiple blocks. For a given block, the boundary shape representation encodes a blocky boundary in a neighborhood around the given block. The positional indicator reflects a distance between the given block and a smooth boundary of the smooth image. In one or more embodiments to smooth a blocky image, a boundary shape representation around a selected block is determined. The representation is encoded as a feature vector and applied to the machine learning system to obtain a positional indicator. The positional indicator is used to compute a location of a smooth boundary of a smooth image.

    DETERMINING STRUCTURE AND FUNCTIONALITY OF SCANNED OBJECTS

    公开(公告)号:US20170255712A1

    公开(公告)日:2017-09-07

    申请号:US15063183

    申请日:2016-03-07

    CPC classification number: G06F17/5086

    Abstract: Methods and systems for generating digital models from objects. In particular, one or more embodiments determine a plurality of correspondences for first and second components of an object. One or more embodiments estimate a joint connecting the first and second components based on the correspondences. One or more embodiments jointly determine a global transformation and one or more joint parameters that map the plurality of components of the object from the first digital scan to the second digital scan. One or more embodiments also updating the correspondences based on the determined global transformation and parameter(s). One or more embodiments re-estimate the joint based on the updated correspondences. One or more embodiments select a candidate joint with a lowest error estimate from a plurality of candidate joints according to determined global transformations and joint parameter(s) for the candidate joints.

Patent Agency Ranking