-
公开(公告)号:US09569816B2
公开(公告)日:2017-02-14
申请号:US14687513
申请日:2015-04-15
Applicant: Apple Inc.
Inventor: Jim C. Chou , Guy Cote , Haiyan He
CPC classification number: G06T3/4007 , G06T5/001 , G06T5/002 , G06T5/10 , G06T2207/10024 , G06T2207/20012 , G06T2207/20028 , G06T2207/20048
Abstract: An image signal processing system may include processing circuitry that may reduce banding artifacts in image data to be depicted on a display. The processing circuitry may receive a first pixel value associated with a first pixel of the image data and detect a first set of pixels located in a first direction along a same row of pixels or a same column of pixels with respect to the first pixel. The first set of pixels is associated with a first band. The processing circuitry may then interpolate a second pixel value based on an average of a first set of pixel values that correspond to the first set of pixels and a distance between the first pixel and a closest pixel in the first band. The processing circuitry may then output the second pixel value for the first pixel.
Abstract translation: 图像信号处理系统可以包括可以减少要在显示器上描绘的图像数据中的带状伪影的处理电路。 处理电路可以接收与图像数据的第一像素相关联的第一像素值,并且相对于第一像素沿同一行像素或相同列的像素检测位于第一方向上的第一组像素。 第一组像素与第一个带相关联。 然后,处理电路可以基于对应于第一组像素的第一组像素值的平均值和第一像素与第一像素中的最近像素之间的距离来内插第二像素值。 处理电路然后可以输出第一像素的第二像素值。
-
公开(公告)号:US09495731B2
公开(公告)日:2016-11-15
申请号:US14687478
申请日:2015-04-15
Applicant: Apple Inc.
Inventor: Jim C. Chou , Guy Cote , Haiyan He
IPC: G06K9/40 , G06T5/00 , G06T5/20 , G06T5/50 , H04N19/117
CPC classification number: G06T5/002 , G06K9/40 , G06T5/20 , G06T5/50 , G06T2207/20182 , G06T2207/20221 , H04N19/117 , H04N19/136 , H04N19/182 , H04N19/86
Abstract: A method for attenuating banding in image data may involve receiving a stream of input pixels. The method may then include applying a bi-lateral filter to a first portion of the stream of input pixels to generate a first filtered output and applying a high pass filter to a second portion of the stream of input pixels to generate a second filtered output. The method may then determine a local activity and a local intensity associated with the first portion of the stream. The method may then include blending the first filtered output with the first portion of the stream of input pixels based at least in part on the local activity and the local intensity to generate a third filtered output. Afterward, the method may combine the third filtered output with the second filtered output to generate a fourth filtered output that may be output as the image data.
Abstract translation: 用于衰减图像数据中的条带的方法可以涉及接收输入像素的流。 该方法可以包括将双向滤波器应用于输入像素流的第一部分以产生第一滤波输出并将高通滤波器应用于输入像素流的第二部分以产生第二滤波输出。 该方法然后可以确定与流的第一部分相关联的局部活动和局部强度。 该方法可以包括至少部分地基于局部活动和局部强度来混合第一滤波输出与输入像素流的第一部分以产生第三滤波输出。 之后,该方法可以组合第三滤波输出和第二滤波输出,以产生可以作为图像数据输出的第四滤波输出。
-
公开(公告)号:US20160307302A1
公开(公告)日:2016-10-20
申请号:US14687478
申请日:2015-04-15
Applicant: Apple Inc.
Inventor: Jim C. Chou , Guy Cote , Haiyan He
CPC classification number: G06T5/002 , G06K9/40 , G06T5/20 , G06T5/50 , G06T2207/20182 , G06T2207/20221 , H04N19/117 , H04N19/136 , H04N19/182 , H04N19/86
Abstract: A method for attenuating banding in image data may involve receiving a stream of input pixels. The method may then include applying a bi-lateral filter to a first portion of the stream of input pixels to generate a first filtered output and applying a high pass filter to a second portion of the stream of input pixels to generate a second filtered output. The method may then determine a local activity and a local intensity associated with the first portion of the stream. The method may then include blending the first filtered output with the first portion of the stream of input pixels based at least in part on the local activity and the local intensity to generate a third filtered output. Afterward, the method may combine the third filtered output with the second filtered output to generate a fourth filtered output that may be output as the image data.
Abstract translation: 用于衰减图像数据中的条带的方法可以涉及接收输入像素的流。 该方法可以包括将双向滤波器应用于输入像素流的第一部分以产生第一滤波输出并将高通滤波器应用于输入像素流的第二部分以产生第二滤波输出。 该方法然后可以确定与流的第一部分相关联的局部活动和局部强度。 该方法可以包括至少部分地基于局部活动和局部强度来混合第一滤波输出与输入像素流的第一部分以产生第三滤波输出。 之后,该方法可以组合第三滤波输出和第二滤波输出,以产生可以作为图像数据输出的第四滤波输出。
-
公开(公告)号:US20150092855A1
公开(公告)日:2015-04-02
申请号:US14039871
申请日:2013-09-27
Applicant: Apple Inc.
Inventor: Jim C. Chou , Craig M. Okruhlica , Guy Cote
IPC: H04N7/26
CPC classification number: H04N19/17 , H04N19/105 , H04N19/147 , H04N19/176 , H04N19/186 , H04N19/192
Abstract: The video encoders described herein may make an initial determination to designate a macroblock as a skip macroblock, but may subsequently reverse that decision based on additional information. For example, an initial skip mode decision may be based on aggregate distortion metrics for the luma component of the macroblock (e.g., SAD, SATD, or SSD), then reversed based on an individual pixel difference metric, an aggregate or individual pixel metric for a chroma component of the macroblock, or on the position of the macroblock within a macroblock row. The final skip mode decision may be based, at least in part, on the maximum difference between any pixel in the macroblock (or in a region of interest within the macroblock) and the corresponding pixel in a reference frame. The initial skip mode decision may be made during an early stage of a pipelined video encoding process and reversed in a later stage.
Abstract translation: 本文描述的视频编码器可以进行初始确定以将宏块指定为跳过宏块,但是随后可以基于附加信息来反转该决定。 例如,初始跳过模式决定可以基于宏块的亮度分量(例如,SAD,SATD或SSD)的聚合失真度量,然后基于单独的像素差异度量来反转,聚合或单独的像素度量用于 宏块的色度分量,或宏块行内宏块的位置。 至少部分地,最终跳过模式决定基于宏块中的任何像素(或宏块内的感兴趣区域)与参考帧中的相应像素之间的最大差异。 初始跳过模式决定可以在流水线视频编码处理的早期阶段进行,并且在稍后的阶段中反转。
-
公开(公告)号:US12238311B2
公开(公告)日:2025-02-25
申请号:US18052807
申请日:2022-11-04
Applicant: Apple Inc.
Inventor: Sorin C. Cismas , Jim C. Chou , Ling Su , Keangpo R. Ho
IPC: H04N19/37 , H04N19/119 , H04N19/164 , H04N19/167 , H04N19/169 , H04N19/174 , H04N19/176 , H04N19/46 , H04N19/63
Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.
-
公开(公告)号:US12081769B2
公开(公告)日:2024-09-03
申请号:US17933057
申请日:2022-09-16
Applicant: Apple Inc.
Inventor: Hao Pan , Jim C. Chou , Felix C. Fernandes
IPC: H04N19/146 , H04L65/70 , H04L65/75 , H04N19/14 , H04N19/169 , H04N19/176 , H04N19/63
CPC classification number: H04N19/146 , H04L65/70 , H04L65/75 , H04N19/14 , H04N19/176 , H04N19/188 , H04N19/63
Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands for a slice of a frame may be buffered so that complexity statistics may be calculated across the frequency bands prior to encoding. The statistics may then be used by a rate control component in determining quantization parameters for the frequency bands for modulating the rate in the encoder for the current slice. The quantization parameters for the frequency bands may be calculated jointly to optimize the quality of the displayed frames after decoder reconstruction and wavelet synthesis on a receiving device. Information about one or more previously processed frames may be used in combination with the statistics for a current slice in determining the quantization parameters for the current slice.
-
公开(公告)号:US12052440B2
公开(公告)日:2024-07-30
申请号:US18301737
申请日:2023-04-17
Applicant: Apple Inc.
Inventor: Jim C. Chou , Sorin C. Cismas
IPC: H04N19/63 , H04N19/117 , H04N19/147 , H04N19/174 , H04N19/176 , H04N19/18
CPC classification number: H04N19/63 , H04N19/117 , H04N19/147 , H04N19/174 , H04N19/176 , H04N19/18
Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.
-
公开(公告)号:US20240087080A1
公开(公告)日:2024-03-14
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
CPC classification number: G06T3/0093 , G06T3/40 , G06T9/001
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US11843776B2
公开(公告)日:2023-12-12
申请号:US17843160
申请日:2022-06-17
Applicant: Apple Inc.
Inventor: Krishnakanth Rapaka , Munehiro Nakazato , Jiandong Shen , Ganesh G. Yadav , Sorin Constantin Cismas , Jim C. Chou , Hao Pan
IPC: H04N19/124 , H04N19/60 , H04N19/126
CPC classification number: H04N19/124 , H04N19/126 , H04N19/60
Abstract: In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.
-
公开(公告)号:US11653026B2
公开(公告)日:2023-05-16
申请号:US17252700
申请日:2019-06-27
Applicant: Apple Inc.
Inventor: Jim C. Chou , Sorin C. Cismas
IPC: H04N19/117 , H04N19/147 , H04N19/63 , H04N19/174 , H04N19/176 , H04N19/18
CPC classification number: H04N19/63 , H04N19/117 , H04N19/147 , H04N19/174 , H04N19/176 , H04N19/18
Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.
-
-
-
-
-
-
-
-
-