SPLIT RENDERING BETWEEN A HEAD-MOUNTED DISPLAY (HMD) AND A HOST COMPUTER

    公开(公告)号:US20210185294A1

    公开(公告)日:2021-06-17

    申请号:US16717940

    申请日:2019-12-17

    Inventor: Yasser Malaika

    Abstract: A rendering workload for an individual frame can be split between a head-mounted display (HMD) and a host computer that is executing an application. To split a rendering workload for a frame, the HMD may send head tracking data to the host computer, and the head tracking data may be used by the host computer to generate pixel data associated with the frame and extra data in addition to the pixel data. The extra data can include, without limitation, pose data, depth data, motion vector data, and/or extra pixel data. The HMD may receive the pixel data and at least some of the extra data, determine an updated pose for the HMD, and apply re-projection adjustments to the pixel data based on the updated pose and the received extra data to obtain modified pixel data, which is used to present an image on the display panel(s) of the HMD.

    USING PUPIL LOCATION TO CORRECT OPTICAL LENS DISTORTION

    公开(公告)号:US20190339529A1

    公开(公告)日:2019-11-07

    申请号:US16512065

    申请日:2019-07-15

    Abstract: The disclosure relates generally to techniques for using information about a user's actual or predicted pupil location for correcting optical distortions that are specific to an optical lens and display assembly through which the user is viewing one or more images. The described techniques may include identifying and mapping optical distortions specific to an optical lens and display assembly, and using such mapped optical distortions to correct images displayed to a wearer or other user receiving images via the assembly, such as based at least in part on pupil location of the wearer or other user. As one example, the one or more optical lens may be mounted inside a head-mounted display (HMD) that also includes a display panel or other image source for an eye of a wearer, and if so one or more pupil tracking mechanisms may be integrated into the HMD.

    Split rendering between a head-mounted display (HMD) and a host computer

    公开(公告)号:US11303875B2

    公开(公告)日:2022-04-12

    申请号:US16717940

    申请日:2019-12-17

    Inventor: Yasser Malaika

    Abstract: A rendering workload for an individual frame can be split between a head-mounted display (HMD) and a host computer that is executing an application. To split a rendering workload for a frame, the HMD may send head tracking data to the host computer, and the head tracking data may be used by the host computer to generate pixel data associated with the frame and extra data in addition to the pixel data. The extra data can include, without limitation, pose data, depth data, motion vector data, and/or extra pixel data. The HMD may receive the pixel data and at least some of the extra data, determine an updated pose for the HMD, and apply re-projection adjustments to the pixel data based on the updated pose and the received extra data to obtain modified pixel data, which is used to present an image on the display panel(s) of the HMD.

    Controlling image display via mapping of pixel values to pixels

    公开(公告)号:US10713997B2

    公开(公告)日:2020-07-14

    申请号:US15934789

    申请日:2018-03-23

    Abstract: Techniques are described for controlling display of video data and/or other image data based at least in part on selective mapping of pixel values to pixels. Such techniques may include separating a display panel into multiple regions, with at least one primary region having a highest resolution of displayed image data and with one or more secondary regions having one or more lower resolutions of displayed image data (e.g., by using a 1-to-M mapping of image pixel values to display panel pixels for each such secondary region, where M is greater than 1, such that each such image pixel value controls the display of M such pixels). The image data may further be encoded and optionally decoded in accordance with such a display panel arrangement, such as to encode the image data per the display panel arrangement to reduce its size before transmission to the display panel.

    Controlling image display via real-time compression in peripheral image regions

    公开(公告)号:US10694170B2

    公开(公告)日:2020-06-23

    申请号:US15912323

    申请日:2018-03-05

    Inventor: Yasser Malaika

    Abstract: Techniques are described for controlling image display via compression of image data in some image regions while performing less or no compression in other (e.g., peripheral view) regions, with color-specific compression preserving chromatic aberration compensation. Such techniques may be used with display panel(s) of a head-mounted display device used for virtual reality display. A primary region of an image at which to encode and display data at a highest resolution level may be determined by tracking a gaze of a user, while other secondary regions may be selected to be surrounding or other outside the primary region. In the secondary regions, image data for a first (e.g., green) color channel may be encoded at a first compression level for a first resolution level lower higher than for other second color channels, and HDR data may be compressed at higher compression levels than the color-specific data.

    USING PUPIL LOCATION TO CORRECT OPTICAL LENS DISTORTION

    公开(公告)号:US20180114298A1

    公开(公告)日:2018-04-26

    申请号:US15335194

    申请日:2016-10-26

    Abstract: The disclosure relates generally to techniques for using information about a user's actual or predicted pupil location for correcting optical distortions that are specific to an optical lens and display assembly through which the user is viewing one or more images. The described techniques may include identifying and mapping optical distortions specific to an optical lens and display assembly, and using such mapped optical distortions to correct images displayed to a wearer or other user receiving images via the assembly, such as based at least in part on pupil location of the wearer or other user. As one example, the one or more optical lens may be mounted inside a head-mounted display (HMD) that also includes a display panel or other image source for an eye of a wearer, and if so one or more pupil tracking mechanisms may be integrated into the HMD.

    CONTROLLING IMAGE DISPLAY VIA MAPPING OF PIXEL VALUES TO PIXELS

    公开(公告)号:US20190295455A1

    公开(公告)日:2019-09-26

    申请号:US15934789

    申请日:2018-03-23

    Abstract: Techniques are described for controlling display of video data and/or other image data based at least in part on selective mapping of pixel values to pixels. Such techniques may include separating a display panel into multiple regions, with at least one primary region having a highest resolution of displayed image data and with one or more secondary regions having one or more lower resolutions of displayed image data (e.g., by using a 1-to-M mapping of image pixel values to display panel pixels for each such secondary region, where M is greater than 1, such that each such image pixel value controls the display of M such pixels). The image data may further be encoded and optionally decoded in accordance with such a display panel arrangement, such as to encode the image data per the display panel arrangement to reduce its size before transmission to the display panel.

Patent Agency Ranking