公开(公告)号：US09569816B2

公开(公告)日：2017-02-14

申请号：US14687513

申请日：2015-04-15

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Guy Cote ,  Haiyan He

IPC: G09G5/28 ,  G09G5/39 ,  G06T3/40 ,  G06T5/00

CPC classification number: G06T3/4007 ,  G06T5/001 ,  G06T5/002 ,  G06T5/10 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20028 ,  G06T2207/20048

Abstract: An image signal processing system may include processing circuitry that may reduce banding artifacts in image data to be depicted on a display. The processing circuitry may receive a first pixel value associated with a first pixel of the image data and detect a first set of pixels located in a first direction along a same row of pixels or a same column of pixels with respect to the first pixel. The first set of pixels is associated with a first band. The processing circuitry may then interpolate a second pixel value based on an average of a first set of pixel values that correspond to the first set of pixels and a distance between the first pixel and a closest pixel in the first band. The processing circuitry may then output the second pixel value for the first pixel.

Abstract translation: 图像信号处理系统可以包括可以减少要在显示器上描绘的图像数据中的带状伪影的处理电路。 处理电路可以接收与图像数据的第一像素相关联的第一像素值，并且相对于第一像素沿同一行像素或相同列的像素检测位于第一方向上的第一组像素。 第一组像素与第一个带相关联。 然后，处理电路可以基于对应于第一组像素的第一组像素值的平均值和第一像素与第一像素中的最近像素之间的距离来内插第二像素值。 处理电路然后可以输出第一像素的第二像素值。

公开(公告)号：US09510002B2

公开(公告)日：2016-11-29

申请号：US14452485

申请日：2014-08-05

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Guy Cote

IPC: H04N19/117 ,  H04N19/124 ,  H04N19/30 ,  H04N19/70 ,  H04N19/126 ,  H04N19/186 ,  H04N19/157 ,  H04N19/136 ,  H04N19/96 ,  H04N19/86

CPC classification number: H04N19/124 ,  H04N19/126 ,  H04N19/13 ,  H04N19/136 ,  H04N19/15 ,  H04N19/157 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/186 ,  H04N19/30 ,  H04N19/51 ,  H04N19/61 ,  H04N19/70 ,  H04N19/86 ,  H04N19/96

Abstract: A method of signaling additional chroma QP offset values that are specific to quantization groups is provided, in which each quantization group explicitly specifies its own set of chroma QP offset values. Alternatively, a table of possible sets of chroma QP offset values is specified in the header area of the picture, and each quantization group uses an index to select an entry from the table for determining its own set of chroma QP offset values. The quantization group specific chroma QP offset values are then used to determine the chroma QP values for blocks within the quantization group in addition to chroma QP offset values already specified for higher levels of the video coding hierarchy.

Abstract translation: 提供了一种用于发信号通知量化组特有的附加色度QP偏移值的方法，其中每个量化组明确地指定其自己的色度QP偏移值集合。 或者，在图像的标题区域中指定可能的色度QP偏移值集合的表，并且每个量化组使用索引来从表中选择用于确定其自己的色度QP偏移值集合的条目。 然后，除了已经为视频编码层级的较高级别指定的色度QP偏移值之外，量化组特定色度QP偏移值用于确定量化组内的块的色度QP值。

公开(公告)号：US09495731B2

公开(公告)日：2016-11-15

申请号：US14687478

申请日：2015-04-15

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Guy Cote ,  Haiyan He

IPC: G06K9/40 ,  G06T5/00 ,  G06T5/20 ,  G06T5/50 ,  H04N19/117

CPC classification number: G06T5/002 ,  G06K9/40 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/20182 ,  G06T2207/20221 ,  H04N19/117 ,  H04N19/136 ,  H04N19/182 ,  H04N19/86

Abstract: A method for attenuating banding in image data may involve receiving a stream of input pixels. The method may then include applying a bi-lateral filter to a first portion of the stream of input pixels to generate a first filtered output and applying a high pass filter to a second portion of the stream of input pixels to generate a second filtered output. The method may then determine a local activity and a local intensity associated with the first portion of the stream. The method may then include blending the first filtered output with the first portion of the stream of input pixels based at least in part on the local activity and the local intensity to generate a third filtered output. Afterward, the method may combine the third filtered output with the second filtered output to generate a fourth filtered output that may be output as the image data.

Abstract translation: 用于衰减图像数据中的条带的方法可以涉及接收输入像素的流。 该方法可以包括将双向滤波器应用于输入像素流的第一部分以产生第一滤波输出并将高通滤波器应用于输入像素流的第二部分以产生第二滤波输出。 该方法然后可以确定与流的第一部分相关联的局部活动和局部强度。 该方法可以包括至少部分地基于局部活动和局部强度来混合第一滤波输出与输入像素流的第一部分以产生第三滤波输出。 之后，该方法可以组合第三滤波输出和第二滤波输出，以产生可以作为图像数据输出的第四滤波输出。

公开(公告)号：US20160307302A1

公开(公告)日：2016-10-20

申请号：US14687478

申请日：2015-04-15

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Guy Cote ,  Haiyan He

IPC: G06T5/00 ,  G06T5/50 ,  G06T5/20

CPC classification number: G06T5/002 ,  G06K9/40 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/20182 ,  G06T2207/20221 ,  H04N19/117 ,  H04N19/136 ,  H04N19/182 ,  H04N19/86

Abstract: A method for attenuating banding in image data may involve receiving a stream of input pixels. The method may then include applying a bi-lateral filter to a first portion of the stream of input pixels to generate a first filtered output and applying a high pass filter to a second portion of the stream of input pixels to generate a second filtered output. The method may then determine a local activity and a local intensity associated with the first portion of the stream. The method may then include blending the first filtered output with the first portion of the stream of input pixels based at least in part on the local activity and the local intensity to generate a third filtered output. Afterward, the method may combine the third filtered output with the second filtered output to generate a fourth filtered output that may be output as the image data.

Abstract translation: 用于衰减图像数据中的条带的方法可以涉及接收输入像素的流。 该方法可以包括将双向滤波器应用于输入像素流的第一部分以产生第一滤波输出并将高通滤波器应用于输入像素流的第二部分以产生第二滤波输出。 该方法然后可以确定与流的第一部分相关联的局部活动和局部强度。 该方法可以包括至少部分地基于局部活动和局部强度来混合第一滤波输出与输入像素流的第一部分以产生第三滤波输出。 之后，该方法可以组合第三滤波输出和第二滤波输出，以产生可以作为图像数据输出的第四滤波输出。

公开(公告)号：US20160292827A1

公开(公告)日：2016-10-06

申请号：US14676615

申请日：2015-04-01

Applicant: Apple Inc.

Inventor： Peter F. Holland ,  Eric Young ,  Guy Cote

IPC: G06T5/00 ,  G06T3/40

CPC classification number: G06T5/002 ,  G06T3/4023

Abstract: Systems, apparatuses, and methods for generating a blur effect on a source image in a power-efficient manner. Pixels of the source image are averaged as they are read into pixel buffers, and then the source image is further downscaled by a first factor. Then, the downscaled source image is upscaled back to the original size, and then this processed image is composited with a semi-transparent image to create a blurred effect of the source image.

Abstract translation: 以功率有效的方式在源图像上产生模糊效果的系统，装置和方法。 源图像的像素在被读取到像素缓冲器中时被平均，然后源图像被第一因子进一步缩小。 然后，将缩小的源图像放大到原始尺寸，然后将该处理后的图像与半透明图像合成，以产生源图像的模糊效果。

公开(公告)号：US09380312B2

公开(公告)日：2016-06-28

申请号：US14331091

申请日：2014-07-14

Applicant: Apple Inc.

Inventor： Guy Cote ,  Xiaojin Shi

IPC: G06K9/00 ,  G06K9/36 ,  H04N19/196 ,  G06K9/46 ,  G06T1/20 ,  H04N19/124 ,  H04N19/139 ,  H04N19/176

CPC classification number: H04N19/196 ,  G06K9/325 ,  G06K9/4642 ,  G06T1/20 ,  H04N19/124 ,  H04N19/139 ,  H04N19/14 ,  H04N19/176 ,  H04N19/42

Abstract: A block input component of a video encoding pipeline may, for a block of pixels in a video frame, compute gradients in multiple directions, and may accumulate counts of the computed gradients in one or more histograms. The block input component may analyze the histogram(s) to compute block-level statistics and determine whether a dominant gradient direction exists in the block, indicating the likelihood that it represents an image containing text. If text is likely, various encoding parameter values may be selected to improve the quality of encoding for the block (e.g., by lowering a quantization parameter value). The computed statistics or selected encoding parameter values may be passed to other stages of the pipeline, and used to bias or control selection of a prediction mode, an encoding mode, or a motion vector. Frame-level or slice-level parameter values may be generated from gradient histograms of multiple blocks.

Abstract translation: 对于视频帧中的像素块，视频编码流水线的块输入分量可以在多个方向上计算梯度，并且可以在一个或多个直方图中累积计算的梯度的计数。 块输入组件可以分析直方图以计算块级统计，并确定块中是否存在显性梯度方向，指示它代表包含文本的图像的可能性。 如果文本很可能，则可以选择各种编码参数值以提高块的编码质量（例如，通过降低量化参数值）。 所计算的统计量或所选择的编码参数值可以被传递到流水线的其他阶段，并且用于偏置或控制预测模式，编码模式或运动矢量的选择。 可以从多个块的梯度直方图生成帧级或片级参数值。

公开(公告)号：US20160173885A1

公开(公告)日：2016-06-16

申请号：US15050061

申请日：2016-02-22

Applicant: Apple Inc.

Inventor： Guy Cote ,  Craig M. Okruhlica

IPC: H04N19/186 ,  H04N19/593 ,  H04N19/423 ,  H04N19/182 ,  H04N19/159 ,  H04N19/96 ,  H04N19/107 ,  H04N19/52 ,  H04N19/13 ,  H04N19/86 ,  H04N19/176 ,  H04N19/40

CPC classification number: H04N19/186 ,  H04N19/107 ,  H04N19/13 ,  H04N19/159 ,  H04N19/176 ,  H04N19/182 ,  H04N19/40 ,  H04N19/423 ,  H04N19/436 ,  H04N19/439 ,  H04N19/52 ,  H04N19/593 ,  H04N19/86 ,  H04N19/96

Abstract: A block processing pipeline in which macroblocks are input to and processed according to row groups so that adjacent macroblocks on a row are not concurrently at adjacent stages of the pipeline. The input method may allow chroma processing to be postponed until after luma processing. One or more upstream stages of the pipeline may process luma elements of each macroblock to generate luma results such as a best mode for processing the luma elements. Luma results may be provided to one or more downstream stages of the pipeline that process chroma elements of each macroblock. The luma results may be used to determine processing of the chroma elements. For example, if the best mode for luma is an intra-frame mode, then a chroma processing stage may determine a best intra-frame mode for chroma and reconstruct the chroma elements according to the best chroma intra-frame mode.

公开(公告)号：US09317930B2

公开(公告)日：2016-04-19

申请号：US13963641

申请日：2013-08-09

Applicant: APPLE INC.

Inventor： David Daming Kuo ,  Guy Cote

IPC: G06T7/40 ,  H04N5/213

CPC classification number: G06T7/408 ,  H04N5/213

Abstract: Systems and methods are provided for collecting image statistics using a pixel mask. In one example, statistics collection logic of an image signal processor may include a pixel weighting mask and accumulation logic. The pixel weighting mask may receive a first representation of a pixel that includes a luma and chroma representation of the pixel. The pixel weighting mask may output a pixel weighting using first and second chroma components of the luma and chroma representation of the pixel. The accumulation logic may receive the first or a second representation of the pixel and the pixel weighting value. Using these, the accumulation logic may weight the second representation of the pixel or the first representation of the pixel using the pixel weighting value to obtain a weighted pixel value, adding the weighted pixel value to a statistics count.

Abstract translation: 提供了使用像素掩码来收集图像统计信息的系统和方法。 在一个示例中，图像信号处理器的统计信息收集逻辑可以包括像素加权掩码和累加逻辑。 像素加权掩模可以接收包括像素的亮度和色度表示的像素的第一表示。 像素加权掩模可以使用像素的亮度和色度表示的第一和第二色度分量来输出像素加权。 累加逻辑可以接收像素的第一或第二表示和像素加权值。 使用这些，累积逻辑可以使用像素加权值来加权像素的第二表示或像素的第一表示，以获得加权像素值，将加权像素值加到统计计数。

公开(公告)号：US20160100170A1

公开(公告)日：2016-04-07

申请号：US14967320

申请日：2015-12-13

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Guy Cote

IPC: H04N19/124 ,  H04N19/30 ,  H04N19/136

CPC classification number: H04N19/124 ,  H04N19/126 ,  H04N19/13 ,  H04N19/136 ,  H04N19/15 ,  H04N19/157 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/186 ,  H04N19/30 ,  H04N19/51 ,  H04N19/61 ,  H04N19/70 ,  H04N19/86 ,  H04N19/96

Abstract: A method of signaling additional chroma QP offset values that are specific to quantization groups is provided, in which each quantization group explicitly specifies its own set of chroma QP offset values. Alternatively, a table of possible sets of chroma QP offset values is specified in the header area of the picture, and each quantization group uses an index to select an entry from the table for determining its own set of chroma QP offset values. The quantization group specific chroma QP offset values are then used to determine the chroma QP values for blocks within the quantization group in addition to chroma QP offset values already specified for higher levels of the video coding hierarchy.

公开(公告)号：US20160065969A1

公开(公告)日：2016-03-03

申请号：US14474114

申请日：2014-08-30

Applicant: Apple Inc.

Inventor： Joseph J. Cheng ,  Timothy J. Millet ,  Shun Wai Go ,  Guy Cote

IPC: H04N19/176 ,  H04N19/182 ,  H04N19/46 ,  H04N19/172

CPC classification number: H04N19/176 ,  G06F9/461 ,  G06F9/4818 ,  H04N19/127 ,  H04N19/129 ,  H04N19/172 ,  H04N19/174 ,  H04N19/182 ,  H04N19/40 ,  H04N19/42 ,  H04N19/46

Abstract: A context switching method for video encoders that enables higher priority video streams to interrupt lower priority video streams. A high priority frame may be received for processing while another frame is being processed. The pipeline may be signaled to perform a context stop for the current frame. The pipeline stops processing the current frame at an appropriate place, and propagates the stop through the stages of the pipeline and to a transcoder through DMA. The stopping location is recorded. The video encoder may then process the higher-priority frame. When done, a context restart is performed and the pipeline resumes processing the lower-priority frame beginning at the recorded location. The transcoder may process data for the interrupted frame while the higher-priority frame is being processed in the pipeline, and similarly the pipeline may begin processing the lower-priority frame after the context restart while the transcoder completes processing the higher-priority frame.

Abstract translation: 一种视频编码器的上下文切换方法，其使得较高优先级的视频流能够中断较低优先级的视频流。 当处理另一帧时，可以接收高优先级帧以进行处理。 可以用信号通知流水线以执行当前帧的上下文停止。 流水线在适当的位置停止处理当前帧，并通过流水线传播停止点，并通过DMA传播到代码转换器。 记录停止位置。 视频编码器然后可以处理较高优先级的帧。 完成后，执行上下文重新启动，并且流水线从记录的位置恢复处理较低优先级的帧。 代码转换器可以在流水线中处理较高优先级帧的同时处理中断帧的数据，类似地，当代码转换器完成处理较高优先级帧时，流水线可以在上下文重新启动之后开始处理较低优先级的帧。