Pre-processing in a display pipeline

    公开(公告)号:US11936844B1

    公开(公告)日:2024-03-19

    申请号:US17343598

    申请日:2021-06-09

    申请人: Apple Inc.

    摘要: An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may have a number of independently controllable viewing zones. Each viewing zone displays a respective two-dimensional image. Each eye of the viewer may receive a different one of the two-dimensional images, resulting in a perceived three-dimensional image. The electronic device may include display pipeline circuitry that generates and processes content to be displayed on the lenticular display. Content generating circuitry may initially generate content that includes a plurality of two-dimensional images, each two-dimensional image corresponding to a respective viewing zone. Pre-processing circuitry may subsequently anisotropically resize each two-dimensional image. Pixel mapping circuitry may then be used to map the resized two-dimensional images to the array of pixels in the lenticular display.

    Optical crosstalk compensation for foveated display

    公开(公告)号:US11929021B1

    公开(公告)日:2024-03-12

    申请号:US18328617

    申请日:2023-06-02

    申请人: Apple Inc.

    IPC分类号: G09G3/3208 G06F3/01

    摘要: Systems and methods are provided for using an optical crosstalk compensation (OXTC) block to compensate for optical crosstalk resulted from a combination of viewing angle change across field of view (FoV), color filter (CF) crosstalk, and the OLED various angle color shift (VACS) of a foveated electronic display. One or more two-dimensional (2D) OXTC factor maps are used to determine OXTC factors for input image data of the OXTC block, and the OXTC factors are updated on a per frame basis. Offset values are determined using a parallel architecture and used to determine the OXTC factors. Compensation weights are used to determine weighted OXTC factors to improve processing efficiency. Output image data are obtained by applying the weighted OXTC factors to the input image data.

    Display with a vignetting mask
    4.
    发明授权

    公开(公告)号:US11741918B1

    公开(公告)日:2023-08-29

    申请号:US17511375

    申请日:2021-10-26

    申请人: Apple Inc.

    IPC分类号: G09G5/10 G06F3/01 G09G3/3208

    摘要: It may be desirable to implement a vignetting effect in a display. The vignetting effect causes the display to have a light-emitting area that gradually fades to a black, non-light-emitting area. The vignetting effect allows for the size and shape of the light-emitting area to be controlled while still being aesthetically pleasing to a viewer. To implement a vignetting mask for the vignetting effect, control circuitry in the electronic device may apply dimming factors to image data for the display. To avoid artifacts caused by the vignetting mask, an initial array of dimming factors for implementing the vignetting mask may have a range between −0.5 and 1.5. After upsampling, clamping may be performed to reduce the range of the dimming factors to between 0 and 1. Ultimately, the dimming factors are applied to image data for each frame to implement the vignetting mask in each frame.

    Foveated display
    5.
    发明授权

    公开(公告)号:US11210990B2

    公开(公告)日:2021-12-28

    申请号:US16325260

    申请日:2017-08-15

    申请人: Apple Inc.

    摘要: An electronic device may have a display and a gaze tracking system. The electronic device may display images on the display that have a higher resolution in a portion of the display that overlaps a gaze location than other portions of the display. Timing controller circuitry and column driver circuitry may include interpolation and filter circuitry. The interpolation and filter circuitry may be used to perform nearest neighbor interpolation and two-dimensional spatial filtering on low resolution image data. Display driver circuitry may be configured to load higher resolution data into selected portions of a display. The display driver circuitry may include low and high resolution image data buffers and configurable row driver circuitry. Block enable transistors may be included in a display to allow selected blocks of pixels to be loaded with high resolution image data.

    Video pipeline
    6.
    发明授权

    公开(公告)号:US11043018B2

    公开(公告)日:2021-06-22

    申请号:US16662952

    申请日:2019-10-24

    申请人: Apple Inc.

    摘要: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

    VISUAL ARTIFACT MITIGATION OF DYNAMIC FOVEATED DISPLAYS

    公开(公告)号:US20210141449A1

    公开(公告)日:2021-05-13

    申请号:US16644920

    申请日:2018-08-30

    申请人: Apple Inc.

    IPC分类号: G06F3/01 G09G3/20

    摘要: The present disclosure relates to electronic devices that include displays that show dynamic foveated content. For example, portions of the content may be shown in different resolutions on different areas of the display based on a user's gaze that can be monitored with an eye tracker. Based on eye tracking data collected by the eye tracker, a processor of the electronic device may stop or slow the transmission of pixel data associated with one or more frames of the content. Additionally, the processor may generate pixel data such that the display may gradually transition from employing dynamic foveation to employing static foveation.

    VIDEO PIPELINE
    10.
    发明申请
    VIDEO PIPELINE 审中-公开

    公开(公告)号:US20200058152A1

    公开(公告)日:2020-02-20

    申请号:US16662952

    申请日:2019-10-24

    申请人: Apple Inc.

    摘要: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.