公开(公告)号：US20180012407A1

公开(公告)日：2018-01-11

申请号：US15206086

申请日：2016-07-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ming Chuang ,  Alvaro Collet Romea ,  Hugues H. Hoppe ,  Fabian Andres Prada Nino

IPC: G06T17/20 ,  G06T13/40 ,  G06T15/04

CPC classification number: G06T17/205 ,  G06T7/75 ,  G06T13/40 ,  G06T15/04 ,  G06T2207/20072 ,  G06T2207/20076

Abstract: In some examples, a computing device can determine synthetic meshes based on source meshes of a source mesh sequence and target meshes of a target mesh sequence. The computing device can then place the respective synthetic meshes based at least in part on a rigid transformation to define a processor-generated character. For example, the computing device can determine subsets of the mesh sequences based on a similarity criterion. The computing device can determine modified first and second meshes having a connectivity corresponding to a reference mesh. The computing device can then determine the synthetic meshes based on the modified first and second meshes. In some examples, the computing device can project source and target textures onto the synthetic mesh to provide projected source and target textures. The computing device can determine a synthetic texture registered to the synthetic mesh based on the projected source and target textures.

公开(公告)号：US20170358133A1

公开(公告)日：2017-12-14

申请号：US15178364

申请日：2016-06-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kristofer N. Iverson ,  Khai Tran ,  Ming Chuang ,  Emmett Lalish

IPC: G06T17/20 ,  H04N13/00 ,  G06T3/40

CPC classification number: G06T17/205 ,  B29C64/386 ,  B33Y50/00 ,  G06T3/4023 ,  G06T3/403 ,  G06T2210/08 ,  H04N13/106 ,  H04N13/194

Abstract: Systems, devices, and methods are described herein for geometrically simplifying three-dimensional (3D) video data. In one aspect, a method may include obtaining 3D data, with the 3D data including a plurality of portions associated with a default resolution priority. A higher resolution priority may be associated with one or more portions of the 3D data. Next, portions of the 3D data may be sorted according to resolution priorities associated with each portion, and geometric simplification may be performed on the sorted portions of the 3D data, beginning with portions associated with a least resolution priority and continuing with portions associated with successively higher resolution priorities. The simplified 3D data may be processed, for example, for rendering on a computing device or transmission to another device for display or generation, such as a 3D printing device for generating a 3D object.

公开(公告)号：US10304244B2

公开(公告)日：2019-05-28

申请号：US15206086

申请日：2016-07-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ming Chuang ,  Alvaro Collet Romea ,  Hugues H. Hoppe ,  Fabian Andres Prada Nino

IPC: G09G5/00 ,  G06T17/20 ,  G06T13/40 ,  G06T15/04 ,  G06T7/73

Abstract: In some examples, a computing device can determine synthetic meshes based on source meshes of a source mesh sequence and target meshes of a target mesh sequence. The computing device can then place the respective synthetic meshes based at least in part on a rigid transformation to define a processor-generated character. For example, the computing device can determine subsets of the mesh sequences based on a similarity criterion. The computing device can determine modified first and second meshes having a connectivity corresponding to a reference mesh. The computing device can then determine the synthetic meshes based on the modified first and second meshes. In some examples, the computing device can project source and target textures onto the synthetic mesh to provide projected source and target textures. The computing device can determine a synthetic texture registered to the synthetic mesh based on the projected source and target textures.

公开(公告)号：US09665978B2

公开(公告)日：2017-05-30

申请号：US14803687

申请日：2015-07-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ming Chuang ,  Alvaro Collet Romea ,  Pat Sweeney ,  Steve Sullivan ,  Don Gillett

IPC: G06T17/20 ,  G06T7/20

CPC classification number: G06T17/205 ,  G06T7/20 ,  G06T7/251 ,  G06T17/20 ,  G06T2207/10028 ,  G06T2207/30196

Abstract: Consistent tessellation via topology-aware surface tracking is provided in which a series of meshes is approximated by taking one or more meshes from the series and calculating a transformation field to transform the keyframe mesh into each mesh of the series, and substituting the transformed keyframe meshes for the original meshes. The keyframe mesh may be selected advisedly based upon a scoring metric. An error measurement on the transformed keyframe exceeding tolerance or threshold may suggest another keyframe be selected for one or more frames in the series. The sequence of frames may be divided into a number of subsequences to permit parallel processing, including two or more recursive levels of keyframe substitution. The transformed keyframe meshes achieve more consistent tessellation of the object across the series.

公开(公告)号：US10930071B2

公开(公告)日：2021-02-23

申请号：US15178364

申请日：2016-06-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kristofer N. Iverson ,  Khai Tran ,  Ming Chuang ,  Emmett Lalish

IPC: G06T17/20 ,  H04N13/106 ,  H04N13/194 ,  G06T3/40 ,  B29C64/386 ,  B33Y50/00

Abstract: Systems, devices, and methods are described herein for geometrically simplifying three-dimensional (3D) video data. In one aspect, a method may include obtaining 3D data, with the 3D data including a plurality of portions associated with a default resolution priority. A higher resolution priority may be associated with one or more portions of the 3D data. Next, portions of the 3D data may be sorted according to resolution priorities associated with each portion, and geometric simplification may be performed on the sorted portions of the 3D data, beginning with portions associated with a least resolution priority and continuing with portions associated with successively higher resolution priorities. The simplified 3D data may be processed, for example, for rendering on a computing device or transmission to another device for display or generation, such as a 3D printing device for generating a 3D object.

公开(公告)号：US10163247B2

公开(公告)日：2018-12-25

申请号：US14799220

申请日：2015-07-14

Applicant: Microsoft Technology Licensing, LLC

Inventor： Alvaro Collet Romea ,  Ming Chuang ,  Pat Sweeney ,  Steve Sullivan

IPC: G06T15/00 ,  G06T9/00 ,  G09G5/391

Abstract: A computing system is configured for context-adaptive allocation of render model resources that may sacrifice some level of detail in a computational description of a 3D scene before rendering in order to accommodate resource limitations in a rendering environment such as available processor cycles, and/or bandwidth for data transmission to a processor. Such resource limitations can often preclude rendering a richly detailed 3D scene, particularly in full-motion and/or in real time. An importance function describing the relative perceptual importance of elements that make up the 3D scene is utilized to enable resources to be adaptively allocated so that more resources go to visual elements of the 3D scene that have a higher perceptual importance. The rendered output may thus optimize visual fidelity for the computational description within the resource constrained rendering environment.

公开(公告)号：US09928645B2

公开(公告)日：2018-03-27

申请号：US14690205

申请日：2015-04-17

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Ming Chuang ,  Dave B. Lindsay

IPC: G06T17/20 ,  G06T17/00 ,  G06T15/40 ,  G06T15/20 ,  G06T7/40 ,  G06T7/60 ,  G06T19/00 ,  G06K9/52 ,  G06T15/04

CPC classification number: G06T17/20 ,  G06K9/52 ,  G06T7/40 ,  G06T7/60 ,  G06T15/04 ,  G06T15/20 ,  G06T15/40 ,  G06T17/00 ,  G06T17/205 ,  G06T19/00 ,  G06T2200/08 ,  G06T2207/10028 ,  G06T2210/36 ,  G06T2210/56

Abstract: Concepts and technologies are described herein for providing raster-based mesh decimation. Generally described, input data defining a model is processed to render the model as a depth map from a multitude of perspectives. By capturing depth map data from a multitude of perspectives, components of the model that are visible from the multitude of perspectives are captured in the depth map data and components that are blocked by the visible components are not captured in the depth map data. Point cloud data is generated by merging the depth map data captured from the multitude of perspectives. Output mesh data is generated by applying a surface reconstruction to the point cloud data. One or more mesh decimation algorithms may be applied to the mesh data. Image data may also be captured from the input data and applied to the output mesh data.

公开(公告)号：US10394221B2

公开(公告)日：2019-08-27

申请号：US15235514

申请日：2016-08-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kristofer N. Iverson ,  Patrick John Sweeney ,  William Crow ,  Dennis Evseev ,  Steven Craig Sullivan ,  Alvaro Collet Romea ,  Ming Chuang ,  Zheng Wang ,  Emmett Lalish

IPC: G06K9/00 ,  G06T7/73 ,  G06T17/00 ,  G06T19/20 ,  G05B19/4099

Abstract: Systems, devices, and methods are described herein for transforming three dimensional (3D) video data into a 3D printable model. In one aspect, a method for transforming 3D video data may include receiving 3D video data indicated or selected for 3D printing. The selected portion or 3D video data, which may include a frame of the 3D video data, may be repaired or modified to generate a 3D model that define at least one enclosed volume. At least one of the enclosed volumes of the 3D video data may be re-oriented based on at least one capability of a target 3D printing device. In some aspects, the re-orienting may be performed to optimize at least one of a total print volume or print orientation of the at least one enclosed volume. In some aspects, the method may be performed in response to a single selection or action performed by a user.

公开(公告)号：US20180046167A1

公开(公告)日：2018-02-15

申请号：US15235514

申请日：2016-08-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kristofer N. Iverson ,  Patrick John Sweeney ,  William Crow ,  Dennis Evseev ,  Steven Craig Sullivan ,  Alvaro Collet Romea ,  Ming Chuang ,  Zheng Wang ,  Emmett Lalish

IPC: G05B19/4099 ,  G06T17/00 ,  G06K9/00 ,  G06T7/00

CPC classification number: G05B19/4099 ,  G05B2219/49023 ,  G06K9/00201 ,  G06T7/73 ,  G06T17/00 ,  G06T19/20 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2219/2021

Abstract: Systems, devices, and methods are described herein for transforming three dimensional (3D) video data into a 3D printable model. In one aspect, a method for transforming 3D video data may include receiving 3D video data indicated or selected for 3D printing. The selected portion or 3D video data, which may include a frame of the 3D video data, may be repaired or modified to generate a 3D model that define at least one enclosed volume. At least one of the enclosed volumes of the 3D video data may be re-oriented based on at least one capability of a target 3D printing device. In some aspects, the re-orienting may be performed to optimize at least one of a total print volume or print orientation of the at least one enclosed volume. In some aspects, the method may be performed in response to a single selection or action performed by a user.