公开(公告)号：US20170285763A1

公开(公告)日：2017-10-05

申请号：US15623332

申请日：2017-06-14

Applicant: Microsoft Technology Licensing, LLC

Inventor： David KIM ,  Shahram IZADI ,  Vivek PRADEEP ,  Steven BATHICHE ,  Timothy Andrew LARGE ,  Karlton David POWELL

IPC: G06F3/01 ,  H04N5/33 ,  G06F3/03 ,  G06F3/042 ,  G06F3/041 ,  G06K9/20 ,  G06K9/52 ,  G06K9/00 ,  G01B11/24 ,  G06K9/46 ,  H04N13/02

CPC classification number: G06F3/017 ,  G01B11/24 ,  G06F3/0325 ,  G06F3/0416 ,  G06F3/0421 ,  G06F3/0425 ,  G06K9/00355 ,  G06K9/00362 ,  G06K9/2036 ,  G06K9/4604 ,  G06K9/52 ,  H04N5/33 ,  H04N13/204

Abstract: A 3D silhouette sensing system is described which comprises a stereo camera and a light source. In an embodiment, a 3D sensing module triggers the capture of pairs of images by the stereo camera at the same time that the light source illuminates the scene. A series of pairs of images may be captured at a predefined frame rate. Each pair of images is then analyzed to track both a retroreflector in the scene, which can be moved relative to the stereo camera, and an object which is between the retroreflector and the stereo camera and therefore partially occludes the retroreflector. In processing the image pairs, silhouettes are extracted for each of the retroreflector and the object and these are used to generate a 3D contour for each of the retroreflector and object.

公开(公告)号：US20220196840A1

公开(公告)日：2022-06-23

申请号：US17565344

申请日：2021-12-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Otmar HILLIGES ,  Malte Hanno WEISS ,  Shahram IZADI ,  David KIM ,  Carsten Curt Eckard ROTHER

IPC: G01S17/894 ,  G06T7/586 ,  G06T7/246 ,  G06T17/00 ,  G06T19/00 ,  H04N13/20 ,  G06T15/00

Abstract: Detecting material properties such reflectivity, true color and other properties of surfaces in a real world environment is described in various examples using a single hand-held device. For example, the detected material properties are calculated using a photometric stereo system which exploits known relationships between lighting conditions, surface normals, true color and image intensity. In examples, a user moves around in an environment capturing color images of surfaces in the scene from different orientations under known lighting conditions. In various examples, surfaces normals of patches of surfaces are calculated using the captured data to enable fine detail such as human hair, netting, textured surfaces to be modeled. In examples, the modeled data is used to render images depicting the scene with realism or to superimpose virtual graphics on the real world in a realistic manner.

公开(公告)号：US20180106905A1

公开(公告)日：2018-04-19

申请号：US15846180

申请日：2017-12-18

Applicant: Microsoft Technology Licensing, LLC

Inventor： Otmar HILLIGES ,  Malte Hanno WEISS ,  Shahram IZADI ,  David KIM ,  Carsten Curt Eckard ROTHER

IPC: G01S17/89 ,  G06T19/00 ,  G06T17/00 ,  G06T7/586 ,  G06T7/246

CPC classification number: G06T15/00 ,  G01S17/89 ,  G06T7/246 ,  G06T7/586 ,  G06T17/00 ,  G06T19/006 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/30244 ,  H04N13/20

Abstract: Detecting material properties such reflectivity, true color and other properties of surfaces in a real world environment is described in various examples using a single hand-held device. For example, the detected material properties are calculated using a photometric stereo system which exploits known relationships between lighting conditions, surface normals, true color and image intensity. In examples, a user moves around in an environment capturing color images of surfaces in the scene from different orientations under known lighting conditions. In various examples, surfaces normals of patches of surfaces are calculated using the captured data to enable fine detail such as human hair, netting, textured surfaces to be modeled. In examples, the modeled data is used to render images depicting the scene with realism or to superimpose virtual graphics on the real world in a realistic manner.

公开(公告)号：US20170236286A1

公开(公告)日：2017-08-17

申请号：US15071133

申请日：2016-03-15

Applicant: Microsoft Technology Licensing, LLC

Inventor： Sean Ryan Francesco Fanello ,  Christoph Rhemann ,  Adarsh Prakash Murthy Kowdle ,  Vladimir Tankovich ,  David KIM ,  Shahram Izadi

IPC: G06T7/00 ,  G06K9/62

CPC classification number: G06K9/6282 ,  G06K9/627 ,  G06T7/0057 ,  G06T7/521 ,  G06T2207/10028 ,  G06T2207/20081

Abstract: Techniques for determining depth for a visual content item using machine-learning classifiers include obtaining a visual content item of a reference light pattern projected onto an object, and determining shifts in locations of pixels relative to other pixels representing the reference light pattern. Disparity, and thus depth, for pixels may be determined by executing one or more classifiers trained to identify disparity for pixels based on the shifts in locations of the pixels relative to other pixels of a visual content item depicting in the reference light pattern. Disparity for pixels may be determined using a visual content item of a reference light pattern projected onto an object without having to match pixels between two visual content items, such as a reference light pattern and a captured visual content item.