Illumination estimation for captured video data in mixed-reality applications

    公开(公告)号:US11043025B2

    公开(公告)日:2021-06-22

    申请号:US16585479

    申请日:2019-09-27

    摘要: Systems and methods for collaborative illumination estimation for mobile mixed-reality devices are provided. Embodiments described herein compose an illumination estimate using video data capturing an environment which includes a reflective object, such as a light probe. Radiance samples are computed from light reflections from the reflective object, which are then interpolated to compose a realistic estimation of physical lighting of the environment. Robust illumination estimation is provided in a computationally efficient manner, supplying real-time updates to facilitate integration with augmented reality (AR) systems and other image processing applications. The computational efficiency of this approach allows for implementation in lower-resource environments, such as mobile devices. In some examples, multiple devices can collaborate to capture the environment from different viewpoints and enhance realism and fidelity in their illumination estimates.