High dynamic range for head-mounted display device

    公开(公告)号:US11209899B2

    公开(公告)日:2021-12-28

    申请号:US15807483

    申请日:2017-11-08

    Abstract: A technique for adjusting the brightness values of images to be displayed on a stereoscopic head mounted display is provided herein. This technique improves the perceived dynamic range of the head mounted display by dynamically adjusting the pixel intensities (also known generally as “exposure”) of the images presented on the head mounted display based on a detected gaze direction. The head mounted display includes an eye tracker that is able to sense the gaze directions of the eyes. The eye tracker, head mounted display, or a processor of a computer system receives this information, determines an intersection point of the eye gaze and a screen within the head mounted display and identifies a gaze area around this intersection point. Using this gaze area, the processing system adjusts the pixel intensities of an image displayed on the screen based on the intensities of the pixels within the gaze area.

    Side information for video data transmission

    公开(公告)号:US11212537B2

    公开(公告)日:2021-12-28

    申请号:US16368293

    申请日:2019-03-28

    Abstract: Systems, apparatuses, and methods for performing efficient video compression are disclosed. A video processing system includes a transmitter sending a video stream over a wireless link to a receiver. The transmitter includes a processor and an encoder. The processor generates rendered blocks of pixels of a video frame, and when the processor predicts a compression level for a given region of the video frame is different from a compression level for immediately neighboring blocks, the processor generates side information. The side information identifies a location of the given region in the video frame and a type of content that causes the compression level differences. The processor sends the rendered video information and the side information as accompanying metadata to the encoder. The encoder updates encoding parameters based on the received side information, and compresses the rendered given region based on the updated encoding parameters.

    HIGH DYNAMIC RANGE FOR HEAD-MOUNTED DISPLAY DEVICE

    公开(公告)号:US20190138088A1

    公开(公告)日:2019-05-09

    申请号:US15807483

    申请日:2017-11-08

    Abstract: A technique for adjusting the brightness values of images to be displayed on a stereoscopic head mounted display is provided herein. This technique improves the perceived dynamic range of the head mounted display by dynamically adjusting the pixel intensities (also known generally as “exposure”) of the images presented on the head mounted display based on a detected gaze direction. The head mounted display includes an eye tracker that is able to sense the gaze directions of the eyes. The eye tracker, head mounted display, or a processor of a computer system receives this information, determines an intersection point of the eye gaze and a screen within the head mounted display and identifies a gaze area around this intersection point. Using this gaze area, the processing system adjusts the pixel intensities of an image displayed on the screen based on the intensities of the pixels within the gaze area.

    SIDE INFORMATION FOR VIDEO DATA TRANSMISSION

    公开(公告)号:US20200314434A1

    公开(公告)日:2020-10-01

    申请号:US16368293

    申请日:2019-03-28

    Abstract: Systems, apparatuses, and methods for performing efficient video compression are disclosed. A video processing system includes a transmitter sending a video stream over a wireless link to a receiver. The transmitter includes a processor and an encoder. The processor generates rendered blocks of pixels of a video frame, and when the processor predicts a compression level for a given region of the video frame is different from a compression level for immediately neighboring blocks, the processor generates side information. The side information identifies a location of the given region in the video frame and a type of content that causes the compression level differences. The processor sends the rendered video information and the side information as accompanying metadata to the encoder. The encoder updates encoding parameters based on the received side information, and compresses the rendered given region based on the updated encoding parameters.

    Multi-plane transmission
    5.
    发明授权

    公开(公告)号:US11418797B2

    公开(公告)日:2022-08-16

    申请号:US16368269

    申请日:2019-03-28

    Abstract: Systems, apparatuses, and methods for performing efficient video transmission are disclosed. In a video processing system, a transmitter identifies multiple planes in a scene. The transmitter renders and compresses each of the multiple planes with a combination of a corresponding compression level and a resolution, which is different from a combination of compression level and resolution of any other plane. For each plane, the transmitter inserts, in multi-plane information, data such as identification of the plane, a location in the video frame for the plane, and one or more of a resolution and compression level for the plane. The transmitter conveys the rendered and compressed planes along with the multi-plane information to a receiver. The receiver decodes each of the planes and insets each of the planes on any lower resolution planes of the multiple planes.

    MULTI-PLANE TRANSMISSION
    6.
    发明申请

    公开(公告)号:US20200314436A1

    公开(公告)日:2020-10-01

    申请号:US16368269

    申请日:2019-03-28

    Abstract: Systems, apparatuses, and methods for performing efficient video transmission are disclosed. In a video processing system, a transmitter identifies multiple planes in a scene. The transmitter renders and compresses each of the multiple planes with a combination of a corresponding compression level and a resolution, which is different from a combination of compression level and resolution of any other plane. For each plane, the transmitter inserts, in multi-plane information, data such as identification of the plane, a location in the video frame for the plane, and one or more of a resolution and compression level for the plane. The transmitter conveys the rendered and compressed planes along with the multi-plane information to a receiver. The receiver decodes each of the planes and insets each of the planes on any lower resolution planes of the multiple planes.

    Image generation based on brain activity monitoring

    公开(公告)号:US10706631B2

    公开(公告)日:2020-07-07

    申请号:US16176578

    申请日:2018-10-31

    Abstract: Systems, methods, and devices for generating an image frame for display to a user. Brain activity sensor data correlated with movement of a user is received. A predicted field of view of the user is determined based on the brain activity sensor data. An image frame is generated based on the predicted field of view. The image frame is transmitted to a display for display to a user. Some implementations provide for receiving and displaying a foveated image frame based on a predicted field of view of a user. Brain activity information of a user is captured. The brain activity information is communicated to a transceiver. The brain activity information is transmitted to a rendering device using the transceiver to generate a foveated image frame based on a predicted field of view of the user. The foveated image frame is received from the rendering device, decoded, and displayed to the user.

    IMAGE GENERATION BASED ON BRAIN ACTIVITY MONITORING

    公开(公告)号:US20200167999A1

    公开(公告)日:2020-05-28

    申请号:US16176578

    申请日:2018-10-31

    Abstract: Systems, methods, and devices for generating an image frame for display to a user. Brain activity sensor data correlated with movement of a user is received. A predicted field of view of the user is determined based on the brain activity sensor data. An image frame is generated based on the predicted field of view. The image frame is transmitted to a display for display to a user. Some implementations provide for receiving and displaying a foveated image frame based on a predicted field of view of a user. Brain activity information of a user is captured. The brain activity information is communicated to a transceiver. The brain activity information is transmitted to a rendering device using the transceiver to generate a foveated image frame based on a predicted field of view of the user. The foveated image frame is received from the rendering device, decoded, and displayed to the user.

Patent Agency Ranking