Illumination estimation for captured video data in mixed-reality applications

    公开(公告)号:US11043025B2

    公开(公告)日:2021-06-22

    申请号:US16585479

    申请日:2019-09-27

    摘要: Systems and methods for collaborative illumination estimation for mobile mixed-reality devices are provided. Embodiments described herein compose an illumination estimate using video data capturing an environment which includes a reflective object, such as a light probe. Radiance samples are computed from light reflections from the reflective object, which are then interpolated to compose a realistic estimation of physical lighting of the environment. Robust illumination estimation is provided in a computationally efficient manner, supplying real-time updates to facilitate integration with augmented reality (AR) systems and other image processing applications. The computational efficiency of this approach allows for implementation in lower-resource environments, such as mobile devices. In some examples, multiple devices can collaborate to capture the environment from different viewpoints and enhance realism and fidelity in their illumination estimates.

    FIDELITY-DRIVEN RUNTIME THERMAL MANAGEMENT FOR NEAR-SENSOR ARCHITECTURES

    公开(公告)号:US20200160482A1

    公开(公告)日:2020-05-21

    申请号:US16684735

    申请日:2019-11-15

    摘要: Fidelity-driven runtime thermal management for near-sensor architectures is provided. In this regard, a runtime controller is provided for controlling an operational mode of a vision or imaging system driven by fidelity demands. The runtime controller is responsible for guaranteeing the fidelity demands of a vision application and coordinating state transfer between operating modes to ensure a smooth transition. Under this approach, the vision application only needs to provide the runtime controller with high-level vision/imaging fidelity demands and when to trigger them. The runtime controller translates these demands into effective thermal management. To do this, the runtime controller applies application-specific requirements into appropriate policy parameters and activates temperature reduction mechanisms, such as clock gating and task offload. Furthermore, the runtime controller continuously adapts the policy parameters to situational settings, such as ambient temperature and ambient lighting, to meet ongoing fidelity demands.

    Fidelity-driven runtime thermal management for near-sensor architectures

    公开(公告)号:US11107181B2

    公开(公告)日:2021-08-31

    申请号:US16684735

    申请日:2019-11-15

    摘要: Fidelity-driven runtime thermal management for near-sensor architectures is provided. In this regard, a runtime controller is provided for controlling an operational mode of a vision or imaging system driven by fidelity demands. The runtime controller is responsible for guaranteeing the fidelity demands of a vision application and coordinating state transfer between operating modes to ensure a smooth transition. Under this approach, the vision application only needs to provide the runtime controller with high-level vision/imaging fidelity demands and when to trigger them. The runtime controller translates these demands into effective thermal management. To do this, the runtime controller applies application-specific requirements into appropriate policy parameters and activates temperature reduction mechanisms, such as clock gating and task offload. Furthermore, the runtime controller continuously adapts the policy parameters to situational settings, such as ambient temperature and ambient lighting, to meet ongoing fidelity demands.