公开(公告)号：US20220196840A1

公开(公告)日：2022-06-23

申请号：US17565344

申请日：2021-12-29

申请人： Microsoft Technology Licensing, LLC

发明人： Otmar HILLIGES ,  Malte Hanno WEISS ,  Shahram IZADI ,  David KIM ,  Carsten Curt Eckard ROTHER

IPC分类号： G01S17/894 ,  G06T7/586 ,  G06T7/246 ,  G06T17/00 ,  G06T19/00 ,  H04N13/20 ,  G06T15/00

摘要： Detecting material properties such reflectivity, true color and other properties of surfaces in a real world environment is described in various examples using a single hand-held device. For example, the detected material properties are calculated using a photometric stereo system which exploits known relationships between lighting conditions, surface normals, true color and image intensity. In examples, a user moves around in an environment capturing color images of surfaces in the scene from different orientations under known lighting conditions. In various examples, surfaces normals of patches of surfaces are calculated using the captured data to enable fine detail such as human hair, netting, textured surfaces to be modeled. In examples, the modeled data is used to render images depicting the scene with realism or to superimpose virtual graphics on the real world in a realistic manner.

公开(公告)号：US20180106905A1

公开(公告)日：2018-04-19

申请号：US15846180

申请日：2017-12-18

申请人： Microsoft Technology Licensing, LLC

发明人： Otmar HILLIGES ,  Malte Hanno WEISS ,  Shahram IZADI ,  David KIM ,  Carsten Curt Eckard ROTHER

IPC分类号： G01S17/89 ,  G06T19/00 ,  G06T17/00 ,  G06T7/586 ,  G06T7/246

CPC分类号： G06T15/00 ,  G01S17/89 ,  G06T7/246 ,  G06T7/586 ,  G06T17/00 ,  G06T19/006 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/30244 ,  H04N13/20

摘要： Detecting material properties such reflectivity, true color and other properties of surfaces in a real world environment is described in various examples using a single hand-held device. For example, the detected material properties are calculated using a photometric stereo system which exploits known relationships between lighting conditions, surface normals, true color and image intensity. In examples, a user moves around in an environment capturing color images of surfaces in the scene from different orientations under known lighting conditions. In various examples, surfaces normals of patches of surfaces are calculated using the captured data to enable fine detail such as human hair, netting, textured surfaces to be modeled. In examples, the modeled data is used to render images depicting the scene with realism or to superimpose virtual graphics on the real world in a realistic manner.