RESILIENT RENDERING FOR AUGMENTED-REALITY DEVICES

    公开(公告)号:US20230224369A1

    公开(公告)日:2023-07-13

    申请号:US17572439

    申请日:2022-01-10

    摘要: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

    Priority-based graphics rendering for multi-part systems

    公开(公告)号:US20230136064A1

    公开(公告)日:2023-05-04

    申请号:US17519437

    申请日:2021-11-04

    IPC分类号: G06T1/20 G06F9/48

    摘要: In an embodiment, a method involves receiving a viewpoint from a headset, receiving, from applications, assets to be rendered using the viewpoint, determining, for each of the assets, a priority score, identifying, based on the determined priority scores, a first subset and a second subset of the assets, instructing a GPU to render, within a first GPU frame, a first superframe using the first subset, enqueuing the first superframe for transmission to the headset with a first priority and at a first pre-scheduled time, instructing the GPU to render, within a second GPU frame, a second superframe using the second subset, and enqueuing the second superframe for transmission to the headset with a second priority lower than the first priority and at a second pre-scheduled time, wherein the GPU has a GPU framerate faster than a pre-scheduled timing interval for transmitting data from the computing system to the headset.

    Resilient rendering for augmented-reality devices

    公开(公告)号:US11917011B2

    公开(公告)日:2024-02-27

    申请号:US17572439

    申请日:2022-01-10

    摘要: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

    Thermal management for extended reality ecosystem

    公开(公告)号:US11886259B2

    公开(公告)日:2024-01-30

    申请号:US17499757

    申请日:2021-10-12

    IPC分类号: G06F1/20 G06F1/16 G06T15/00

    摘要: A method by a computing system associated with a set of disjoint devices that includes at least one wearable device includes receiving a request to perform a task. The method further includes determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices. The method further includes determining a plurality of workload assignments needed to be performed to accomplish the task. The method further includes distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices. The method further includes performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

    THERMAL MANAGEMENT FOR EXTENDED REALITY ECOSYSTEM

    公开(公告)号:US20230112115A1

    公开(公告)日:2023-04-13

    申请号:US17499757

    申请日:2021-10-12

    IPC分类号: G06F1/20 G06F1/16 G06T15/00

    摘要: A method by a computing system associated with a set of disjoint devices that includes at least one wearable device includes receiving a request to perform a task. The method further includes determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices. The method further includes determining a plurality of workload assignments needed to be performed to accomplish the task. The method further includes distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices. The method further includes performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

    RESILIENT RENDERING FOR AUGMENTED-REALITY DEVICES

    公开(公告)号:US20240205294A1

    公开(公告)日:2024-06-20

    申请号:US18589305

    申请日:2024-02-27

    摘要: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the fist subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

    Display peak power management for artificial reality systems

    公开(公告)号:US11881143B2

    公开(公告)日:2024-01-23

    申请号:US17499633

    申请日:2021-10-12

    IPC分类号: G09G3/20 G06F3/01

    摘要: In particular embodiments, a computing system of a device may determine a display peak power budget allocated for a display component of the device. The system may determine display information including display workload and display telemetry associated with the display component. The system may determine, in accordance with a display peak power management policy applied to the display peak power budget and the display information, one or more display-controlling parameters for maintaining the display component to operate within the display peak power budget. The system may determine, based on the one or more display-controlling parameters, a plurality of grayscales for a plurality of regions on a display screen of the device. The system may adjust a rendered frame based on the plurality of grayscales and output the adjusted rendered frame on the display screen of the device.

    RENDERING WORKLOAD MANAGEMENT FOR EXTENDED REALITY

    公开(公告)号:US20230215074A1

    公开(公告)日:2023-07-06

    申请号:US17567793

    申请日:2022-01-03

    发明人: Eugene Gorbatov

    IPC分类号: G06T15/00

    CPC分类号: G06T15/005

    摘要: A method by a computing system of a device includes receiving a request to render a frame comprising one or more virtual content and determining, for the one or more virtual content, an associated characteristic. The method further includes determining whether to reduce a rendering workload associated with rendering the frame to satisfy one or more power or thermal constraints associated with the device. In response to a determination to reduce the rendering workload, the method further includes generating a set of rending parameters for rendering the frame in order to reduce the rendering workload. At least one rendering parameter in the set of rendering parameters is determined based on the characteristic associated with the one or more virtual content. The method thus includes rendering the frame in accordance with the set of rending parameters so as to satisfy the one or more power or thermal constraints.

    DISPLAY PEAK POWER MANAGEMENT FOR ARTIFICIAL REALITY SYSTEMS

    公开(公告)号:US20230113746A1

    公开(公告)日:2023-04-13

    申请号:US17499633

    申请日:2021-10-12

    IPC分类号: G09G3/20 G06F3/01

    摘要: In particular embodiments, a computing system of a device may determine a display peak power budget allocated for a display component of the device. The system may determine display information including display workload and display telemetry associated with the display component. The system may determine, in accordance with a display peak power management policy applied to the display peak power budget and the display information, one or more display-controlling parameters for maintaining the display component to operate within the display peak power budget. The system may determine, based on the one or more display-controlling parameters, a plurality of grayscales for a plurality of regions on a display screen of the device. The system may adjust a rendered frame based on the plurality of grayscales and output the adjusted rendered frame on the display screen of the device.