-
公开(公告)号:US11989854B2
公开(公告)日:2024-05-21
申请号:US17356223
申请日:2021-06-23
Applicant: Apple Inc.
Inventor: Jim C. Chou , Jian Zhou
CPC classification number: G06T5/006 , G06N20/00 , G06T3/0093
Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to generate the processed image data. The image processing circuitry may receive input image data corresponding to an image in a first perspective and warp the input image data from the first perspective to a second perspective, generating warped image data. Additionally, the image processing circuitry may determine one or more occluded regions in the second perspective and determine fill-data corresponding to the occluded regions. The processed image data may be generated by combining the warped image data and the fill-data.
-
公开(公告)号:US20230351672A1
公开(公告)日:2023-11-02
申请号:US18344294
申请日:2023-06-29
Applicant: Apple Inc.
Inventor: Arthur Y. Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
CPC classification number: G06T15/005 , G06F3/012 , G06T3/0093 , G06T9/00 , H04W76/10 , H04W88/08
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user’s environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US20230254510A1
公开(公告)日:2023-08-10
申请号:US18301737
申请日:2023-04-17
Applicant: Apple Inc.
Inventor: Jim C. Chou , Sorin C. Cismas
IPC: H04N19/63 , H04N19/117 , H04N19/147 , H04N19/174 , H04N19/176 , H04N19/18
CPC classification number: H04N19/63 , H04N19/117 , H04N19/147 , H04N19/174 , H04N19/176 , H04N19/18
Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.
-
公开(公告)号:US11638041B2
公开(公告)日:2023-04-25
申请号:US17385549
申请日:2021-07-26
Applicant: Apple Inc.
Inventor: Jim C. Chou , Syed Muhammad A. Rizvi
IPC: H04N19/91 , H04N19/156 , H04N19/174 , H04N19/436 , H04N19/127
Abstract: Systems and methods for improving determination of encoded image data using a video encoding pipeline, which includes a first transcode engine that entropy encodes a first portion of a bin stream to determine a first bit stream including first encoded image data that indicates a first coding group row and that determines first characteristic data corresponding to the first bit stream to facilitate communicating a combined bit stream; and a second transcode engine that entropy encodes a second portion of the bin stream to determine a second bit stream including second encoded image data that indicates a second coding group row while the first transcode engine entropy encodes the first portion of the bin stream and that determines second characteristic data corresponding to the second bit stream to facilitate communicating the combined bit stream, which includes the first bit stream and the second bit stream, to a decoding device.
-
公开(公告)号:US20220414824A1
公开(公告)日:2022-12-29
申请号:US17356216
申请日:2021-06-23
Applicant: Apple Inc.
Inventor: Jim C. Chou , Jian Zhou
Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to determine a hierarchical grid having multiple grid points divided into grid partitions. A first set of grid points associated with a first set of grid partitions may include a first set of mappings to corresponding coordinates of input image data in a source frame. The image processing circuitry may also interpolate between the first set of grid points to determine a second set of grid points of having a second set of mappings to corresponding coordinates of the input image data based on the first set of mappings. The image processing circuitry may also generate the processed image data by applying the first set of mappings and the second set of mappings to the input image data.
-
公开(公告)号:US11367167B2
公开(公告)日:2022-06-21
申请号:US17000260
申请日:2020-08-21
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号:US11335296B2
公开(公告)日:2022-05-17
申请号:US17020710
申请日:2020-09-14
Applicant: Apple Inc.
Inventor: Jim C. Chou , Honkai Tam , Roy G. Moss , Arthur L. Spence
Abstract: An electronic device includes a display panel and image processing circuitry. The image processing circuitry receives input image data corresponding to an image to display on the display panel, modifies the input image data by executing a first context task (e.g., lower priority task), and receives a context switch request. The image processing circuitry also pauses modification of the input image data by pausing execution of the first context task and then switches to modifying the input image data by executing a second context task (e.g., higher priority task).
-
公开(公告)号:US20220086505A1
公开(公告)日:2022-03-17
申请号:US17385549
申请日:2021-07-26
Applicant: Apple Inc.
Inventor: Jim C. Chou , Syed Muhammad A. Rizvi
IPC: H04N19/91 , H04N19/156 , H04N19/174 , H04N19/436 , H04N19/127
Abstract: Systems and methods for improving determination of encoded image data using a video encoding pipeline, which includes a first transcode engine that entropy encodes a first portion of a bin stream to determine a first bit stream including first encoded image data that indicates a first coding group row and that determines first characteristic data corresponding to the first bit stream to facilitate communicating a combined bit stream; and a second transcode engine that entropy encodes a second portion of the bin stream to determine a second bit stream including second encoded image data that indicates a second coding group row while the first transcode engine entropy encodes the first portion of the bin stream and that determines second characteristic data corresponding to the second bit stream to facilitate communicating the combined bit stream, which includes the first bit stream and the second bit stream, to a decoding device.
-
公开(公告)号:US20220084482A1
公开(公告)日:2022-03-17
申请号:US17020710
申请日:2020-09-14
Applicant: Apple Inc.
Inventor: Jim C. Chou , Honkai Tam , Roy G. Moss , Arthur L. Spence
Abstract: An electronic device includes a display panel and image processing circuitry. The image processing circuitry receives input image data corresponding to an image to display on the display panel, modifies the input image data by executing a first context task (e.g., lower priority task), and receives a context switch request. The image processing circuitry also pauses modification of the input image data by pausing execution of the first context task and then switches to modifying the input image data by executing a second context task (e.g., higher priority task).
-
公开(公告)号:US20220058773A1
公开(公告)日:2022-02-24
申请号:US17000260
申请日:2020-08-21
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
-
-
-
-
-
-
-
-