-
公开(公告)号:US11871052B1
公开(公告)日:2024-01-09
申请号:US16580184
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Hao Pan , Haitao Guo , Ke Chen , Francesco Iacopino , Jim C. Chou , Xiaohua Yang , Linfeng Guo , Munehiro Nakazato , Krishnakanth Rapaka , Ye Cong
IPC: G06F15/16 , H04N21/2343 , G02B27/00 , G06T19/00 , H04N21/2662
CPC classification number: H04N21/2343 , G02B27/0093 , G06T19/006 , H04N21/2662
Abstract: In one implementation, a method of generating a bit stream encoding a video stream is performed by a device including one or more processors and non-transitory memory. The method includes decomposing a video stream into a plurality of frequency band video streams. The method includes determining a target bitrate and determining, for each frequency band video stream, a respective frequency band bit rate based on the target bit rate. The method includes encoding each of the plurality of frequency band video streams at its respective frequency band bit rate and transmitting, over a channel, each encoded frequency band video stream.
-
102.
公开(公告)号:US20230396824A1
公开(公告)日:2023-12-07
申请号:US18329040
申请日:2023-06-05
Applicant: Apple Inc.
Inventor: Moinul H. Khan , Jim C. Chou , Sorin C. Cismas
IPC: H04N21/2662 , H04N19/59 , H04L1/00 , H04W72/542
CPC classification number: H04N21/2662 , H04N19/59 , H04L1/0009 , H04L1/0003 , H04W72/542
Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.
-
公开(公告)号:US11616960B2
公开(公告)日:2023-03-28
申请号:US17210478
申请日:2021-03-23
Applicant: Apple Inc.
Inventor: Jim C. Chou , Alexandros Tourapis
IPC: H04N19/159 , H04N19/154 , H04N19/59 , H04N19/86 , H04N19/46 , G06T9/00 , G06N3/04 , G06N3/08 , H04N19/102 , H04N19/117 , H04N19/189 , H04N19/132 , H04N19/90 , H04N19/136 , H04N19/172 , H04N19/436
Abstract: System and method for improving video encoding and/or video decoding. In embodiments, a video encoding pipeline includes a main encoding pipeline that compresses source image data corresponding with an image frame by processing the source image data based at least in part on encoding parameters to generate encoded image data. Additionally the video encoding pipeline includes a machine learning block communicatively coupled to the main encoding pipeline, in which the machine learning block analyzes content of the image frame by processing the source image data based at least in part on machine learning parameters implemented in the machine learning block when the machine learning block is enabled by the encoding parameters; and the video encoding pipeline adaptively adjusts the encoding parameters based at least in part on the content expected to be present in the image frame to facilitate improving encoding efficiency.
-
公开(公告)号:US11606569B2
公开(公告)日:2023-03-14
申请号:US16583153
申请日:2019-09-25
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Yeping Su , Khaled Mammou , Jungsun Kim , David W. Singer , Fabrice A. Robinet , Guy Cote , Jim C. Chou , Hsi-Jung Wu
IPC: H04N19/186 , H04N19/159 , H04N19/176 , H04N19/124
Abstract: Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.
-
公开(公告)号:US20220414840A1
公开(公告)日:2022-12-29
申请号:US17356219
申请日:2021-06-23
Applicant: Apple Inc.
Inventor: Jim C. Chou , Jian Zhou
Abstract: An electronic device may include an electronic display to display an image based on compensated image data in a panel space. The electronic device may also include image processing circuitry to generate the compensated image data. Further, generating the compensated image data may include determining a first inverse mapping of a pixel grid from the panel space to a rendering space and determining a forward mapping of the pixel grid from the rendering space to the panel space based on the first inverse mapping. The forward mapping may include corrections for multiple different warp operations stacked in a single warp operation. Additionally, the image processing circuitry may apply the forward mapping to input image data to generate the compensated image data.
-
公开(公告)号:US11496758B2
公开(公告)日:2022-11-08
申请号:US17252697
申请日:2019-06-27
Applicant: Apple Inc.
Inventor: Sorin C. Cismas , Jim C. Chou , Ling Su , Keangpo R. Ho
IPC: H04N19/37 , H04N19/119 , H04N19/164 , H04N19/167 , H04N19/174 , H04N19/176 , H04N19/169 , H04N19/46 , H04N19/63
Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.
-
公开(公告)号:US20220329805A1
公开(公告)日:2022-10-13
申请号:US17843160
申请日:2022-06-17
Applicant: Apple Inc.
Inventor: Krishnakanth Rapaka , Munehiro Nakazato , Jiandong Shen , Ganesh G. Yadav , Sorin Constantin Cismas , Jim C. Chou , Hao Pan
IPC: H04N19/124 , H04N19/60
Abstract: In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.
-
公开(公告)号:US20220309616A1
公开(公告)日:2022-09-29
申请号:US17841387
申请日:2022-06-15
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号:US20220270567A1
公开(公告)日:2022-08-25
申请号:US17742251
申请日:2022-05-11
Applicant: Apple Inc.
Inventor: Jim C. Chou , Honkai Tam , Roy G. Moss , Arthur L. Spence
Abstract: An electronic device includes a display panel and image processing circuitry. The image processing circuitry receives input image data corresponding to an image to display on the display panel, modifies the input image data by executing a first context task (e.g., lower priority task), and receives a context switch request. The image processing circuitry also pauses modification of the input image data by pausing execution of the first context task and then switches to modifying the input image data by executing a second context task (e.g., higher priority task).
-
公开(公告)号:US11270409B1
公开(公告)日:2022-03-08
申请号:US17029396
申请日:2020-09-23
Applicant: Apple Inc.
Inventor: Raffi A. Bedikian , Mohamed Selim Ben Himane , Pedro Manuel Da Silva Quelhas , Moinul Khan , Katharina Buckl , Jim C. Chou , Julien Monat Rodier
IPC: G06T3/00 , G02B27/01 , G02B27/00 , H04N13/117
Abstract: A method includes obtaining an image via an image sensor. The method includes determining a first perceptual quality value that is associated with a first portion of the image. The method includes determining a first image perceptual quality warping function that is based on the first perceptual quality value and an image warping map. The first image perceptual quality warping function is characterized by a first warping granularity level that is a function of the first perceptual quality value. The method includes warping the first portion of the image according to the first image perceptual quality warping function.
-
-
-
-
-
-
-
-
-