公开(公告)号：US09928420B2

公开(公告)日：2018-03-27

申请号：US13925762

申请日：2013-06-24

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Kirk ,  Oliver A. Whyte ,  Sing Bing Kang ,  Charles Lawrence Zitnick, III ,  Richard S. Szeliski ,  Shahram Izadi ,  Christoph Rhemann ,  Andreas Georgiou ,  Avronil Bhattacharjee

IPC: H04N13/00 ,  H04N5/33 ,  G06K9/00 ,  G06K9/62 ,  G06F11/30 ,  G06F3/06 ,  G06F9/30 ,  G06F12/02 ,  G06F12/00 ,  B29C64/386 ,  H04N13/02 ,  G02B27/42 ,  G02B5/18 ,  G02B27/44 ,  H04N5/225 ,  H04N9/04 ,  H04N17/00 ,  G01B11/25 ,  G01B11/22 ,  G06T1/60 ,  G06T7/00 ,  G06T7/586 ,  B29C64/00 ,  A63F13/213

CPC classification number: G06K9/00536 ,  A63F13/213 ,  B29C64/00 ,  B29C64/386 ,  G01B11/22 ,  G01B11/25 ,  G01B11/2513 ,  G01B11/2527 ,  G01B11/2545 ,  G02B5/1895 ,  G02B27/4205 ,  G02B27/4233 ,  G02B27/44 ,  G06F3/0653 ,  G06F3/0659 ,  G06F3/0683 ,  G06F9/3004 ,  G06F9/30043 ,  G06F9/30127 ,  G06F11/3024 ,  G06F12/00 ,  G06F12/02 ,  G06F12/0207 ,  G06F12/0292 ,  G06K9/00201 ,  G06K9/0063 ,  G06K9/62 ,  G06T1/60 ,  G06T7/00 ,  G06T7/586 ,  G06T2207/30244 ,  H04N5/2256 ,  H04N5/33 ,  H04N5/332 ,  H04N9/045 ,  H04N13/128 ,  H04N13/239 ,  H04N13/25 ,  H04N13/254 ,  H04N13/271 ,  H04N17/002 ,  H04N2013/0081

Abstract: The subject disclosure is directed towards a high resolution, high frame rate, robust stereo depth system. The system provides depth data in varying conditions based upon stereo matching of images, including actively illuminated IR images in some implementations. A clean IR or RGB image may be captured and used with any other captured images in some implementations. Clean IR images may be obtained by using a notch filter to filter out the active illumination pattern. IR stereo cameras, a projector, broad spectrum IR LEDs and one or more other cameras may be incorporated into a single device, which may also include image processing components to internally compute depth data in the device for subsequent output.

公开(公告)号：US10726255B2

公开(公告)日：2020-07-28

申请号：US13924464

申请日：2013-06-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Kirk ,  Christoph Rhemann ,  Oliver A. Whyte ,  Shahram Izadi ,  Sing Bing Kang

IPC: G06K9/00 ,  H04N5/33 ,  G06K9/62 ,  G06F11/30 ,  G06F3/06 ,  G06F9/30 ,  G06F12/02 ,  G06F12/00 ,  B29C64/386 ,  H04N13/128 ,  H04N13/25 ,  H04N13/254 ,  H04N13/271 ,  G06T7/586 ,  H04N5/225 ,  H04N9/04 ,  H04N17/00 ,  G01B11/25 ,  G06T1/60 ,  B29C64/00 ,  H04N13/239 ,  G02B27/42 ,  G02B5/18 ,  G02B27/44 ,  G01B11/22 ,  G06T7/00 ,  H04N13/00 ,  A63F13/213

Abstract: Systems and methods for stereo matching based upon active illumination using a patch in a non-actively illuminated image to obtain weights that are used in patch similarity determinations in actively illuminated stereo images is provided. To correlate pixels in actively illuminated stereo images, adaptive support weights computations are used to determine similarity of patches corresponding to the pixels. In order to obtain adaptive support weights for the adaptive support weights computations, weights are obtained by processing a non-actively illuminated (“clean”) image.

公开(公告)号：US11265534B2

公开(公告)日：2022-03-01

申请号：US14176064

申请日：2014-02-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Kirk ,  Christoph Rhemann ,  Oliver A. Whyte ,  Shahram Izadi ,  Sing Bing Kang ,  Andreas Georgiou

IPC: H04N13/363 ,  G01B11/16 ,  H04N5/33 ,  H04N9/31

Abstract: The subject disclosure is directed towards controlling the intensity of illumination of a scene or part of a scene, including to conserve illumination power. Quality of depth data in stereo images may be measured with different illumination states; environmental conditions, such as ambient light, natural texture may affect the quality. The illumination intensity may be controllably varied to obtain sufficient quality while conserving power. The control may be directed to one or more regions of interest corresponding to an entire scene or part of a scene.

公开(公告)号：US10929658B2

公开(公告)日：2021-02-23

申请号：US13924464

申请日：2013-06-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Kirk ,  Christoph Rhemann ,  Oliver A. Whyte ,  Shahram Izadi ,  Sing Bing Kang

IPC: G06K9/00 ,  H04N5/33 ,  G06K9/62 ,  G06F11/30 ,  G06F3/06 ,  G06F9/30 ,  G06F12/02 ,  G06F12/00 ,  B29C64/386 ,  H04N13/128 ,  H04N13/25 ,  H04N13/254 ,  H04N13/271 ,  G06T7/586 ,  H04N5/225 ,  H04N9/04 ,  H04N17/00 ,  G01B11/25 ,  G06T1/60 ,  B29C64/00 ,  H04N13/239 ,  G02B27/42 ,  G02B5/18 ,  G02B27/44 ,  G01B11/22 ,  G06T7/00 ,  H04N13/00 ,  A63F13/213

Abstract: Systems and methods for stereo matching based upon active illumination using a patch in a non-actively illuminated image to obtain weights that are used in patch similarity determinations in actively illuminated stereo images is provided. To correlate pixels in actively illuminated stereo images, adaptive support weights computations are used to determine similarity of patches corresponding to the pixels. In order to obtain adaptive support weights for the adaptive support weights computations, weights are obtained by processing a non-actively illuminated (“clean”) image.