公开(公告)号：US20070201562A1

公开(公告)日：2007-08-30

申请号：US11673423

申请日：2007-02-09

申请人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

发明人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

IPC分类号： H04N7/12

CPC分类号： G06F9/5044 ,  H04N19/12 ,  H04N19/124 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/42 ,  H04N19/61 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/64784

摘要： A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.

公开(公告)号：US07929599B2

公开(公告)日：2011-04-19

申请号：US11276336

申请日：2006-02-24

申请人： Anand Ganesh ,  Donald J Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

发明人： Anand Ganesh ,  Donald J Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

IPC分类号： H04B1/66

CPC分类号： G06F9/5044 ,  H04N19/12 ,  H04N19/124 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/42 ,  H04N19/61 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/64784

摘要： A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.

摘要翻译： 描述了增加视频编码的速度和质量中的一个或多个的视频编码加速服务。 该服务充当任意视频编码器计算机程序应用程序和任意视频加速硬件之间的中介。 该服务从视频编码器接收一个或多个查询以识别视频加速硬件的实现细节。 该服务与视频加速硬件接口获取实现细节。 该服务将实现细节传达给视频编码器。 实施细节使得视频编码器能够：（a）确定是否可以通过实现一个或多个支持的编码流水线配置和能力的流水线来增加与视频编码器相关联的软件编码操作的速度和质量的一个或多个，以及 （b）通过与服务接口实施管道。

公开(公告)号：US08654842B2

公开(公告)日：2014-02-18

申请号：US11673423

申请日：2007-02-09

申请人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

发明人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

IPC分类号： H04N7/12

CPC分类号： G06F9/5044 ,  H04N19/12 ,  H04N19/124 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/42 ,  H04N19/61 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/64784

摘要： A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.

摘要翻译： 描述了增加视频编码的速度和质量中的一个或多个的视频编码加速服务。 该服务充当任意视频编码器计算机程序应用程序和任意视频加速硬件之间的中介。 该服务从视频编码器接收一个或多个查询以识别视频加速硬件的实现细节。 该服务与视频加速硬件接口获取实现细节。 该服务将实现细节传达给视频编码器。 实施细节使得视频编码器能够：（a）确定是否可以通过实现一个或多个支持的编码流水线配置和能力的流水线来增加与视频编码器相关联的软件编码操作的速度和质量的一个或多个，以及 （b）通过与服务接口实施管道。

公开(公告)号：US07936933B2

公开(公告)日：2011-05-03

申请号：US11282173

申请日：2005-11-18

申请人： Glenn F. Evans ,  Shyam Sadhwani

发明人： Glenn F. Evans ,  Shyam Sadhwani

IPC分类号： G06K9/36 ,  H04N11/02

CPC分类号： H04N19/127 ,  H04N19/136 ,  H04N19/179 ,  H04N19/423 ,  H04N19/44 ,  H04N19/61

摘要： Accelerating video data decoding is described. In one aspect, hardware accelerated video decoding operations are configured to decode source video data in a first encoded data format. During video data processing operations, the source video data is evaluated to detect any change in the encoding format. Responsive to detecting a change in the source video data encoding, wherein the changed encoding is at least partially incompatible with the first encoded data format, the hardware accelerated video decoding operations are dynamically reconfigured. The reconfigured decoding operations decode the source video data content based on the changed encoded data format.

摘要翻译： 描述加速视频数据解码。 在一个方面，硬件加速视频解码操作被配置为以第一编码数据格式解码源视频数据。 在视频数据处理操作期间，评估源视频数据以检测编码格式的任何改变。 响应于检测源视频数据编码的变化，其中改变的编码与第一编码数据格式至少部分不兼容，硬件加速视频解码操作被动态地重新配置。 重新配置的解码操作基于改变的编码数据格式解码源视频数据内容。

公开(公告)号：US07400762B2

公开(公告)日：2008-07-15

申请号：US11276790

申请日：2006-03-14

申请人： Donald J. Munsil ,  Glenn F. Evans ,  Stacey L. Spears

发明人： Donald J. Munsil ,  Glenn F. Evans ,  Stacey L. Spears

IPC分类号： G06K9/00

CPC分类号： H04N1/4053

摘要： Strategies are set forth for performing a scaling operation on image information using a filter. According to one exemplary implementation, the strategies involve: computing, based on scaling to be performed, a number of filter kernels required to implement the filter and a number of taps required for each filter kernel; pre-computing and storing the number of filter kernels; and applying the filter kernels to a row or column of the image information by repeatedly sequencing through the filter kernels if there are more pixel elements in the row or column than there are pre-calculated filter kernels. The scaling operation can employ a Catmull-Rom filter. Further, the scaling operations can be implemented by a pixel shader by assigning weighting information and delta-shifted versions of the image information to respective texture units of the pixel shader.

摘要翻译： 阐述了使用滤波器对图像信息进行缩放操作的策略。 根据一个示例性实现，策略涉及：基于要执行的缩放来计算实现滤波器所需的多个滤波器内核以及每个滤波器核所需的多个抽头; 预先计算并存储过滤内核的数量; 以及如果在行或列中存在比预先计算的滤波器内核更多的像素元素，则通过重复排序穿过滤波器内核，将滤波器内核应用于图像信息的行或列。 缩放操作可以使用Catmull-Rom过滤器。 此外，通过将像素着色器的加权信息和图像信息的增量移位版本分配给像素着色器的各个纹理单元，可以通过像素着色器来实现缩放操作。

公开(公告)号：US07308151B2

公开(公告)日：2007-12-11

申请号：US11276788

申请日：2006-03-14

申请人： Donald J. Munsil ,  Glenn F. Evans ,  Stacey L. Spears

发明人： Donald J. Munsil ,  Glenn F. Evans ,  Stacey L. Spears

IPC分类号： G06K9/36

CPC分类号： H04N1/4053

摘要： Strategies are set forth herein for quantizing and dithering original image information to produce quantized image information. According to one exemplary implementation, the strategies involve: quantizing a sum that combines an original value taken from the original image information, a noise value, and an error term, to produce a quantized value; and calculating an error term for a subsequent quantizing operation by computing a difference between the quantized value and the original value. By virtue of his process, the strategies essentially add noise information to the quantization process, not the original image information, which results in quantized image information having reduced artifacts. The strategies can be used in conjunction with the Floyd-Steinberg error dispersion algorithm. According to another feature, the noise value is computed using a random number generator having a long repeat period, which further reduces artifacts.

摘要翻译： 这里阐述了用于量化和抖动原始图像信息以产生量化的图像信息的策略。 根据一个示例性实现，策略涉及：量化组合从原始图像信息获取的原始值，噪声值和误差项的和以产生量化值; 以及通过计算量化值和原始值之间的差来计算后续量化操作的误差项。 凭借其过程，策略基本上将量化过程的噪声信息添加到原始图像信息中，这导致具有减少的伪影的量化的图像信息。 该策略可以与Floyd-Steinberg误差色散算法结合使用。 根据另一个特征，使用具有长重复周期的随机数发生器来计算噪声值，这进一步减少伪像。

公开(公告)号：US07158668B2

公开(公告)日：2007-01-02

申请号：US10987378

申请日：2004-11-12

申请人： Donald J. Munsil ,  Glenn F. Evans ,  Stacey L. Spears

发明人： Donald J. Munsil ,  Glenn F. Evans ,  Stacey L. Spears

IPC分类号： G06K9/00

CPC分类号： H04N1/4053

摘要： Strategies are described for processing image information in a linear form to reduce the amount of artifacts (compared to processing the data in nonlinear form). Exemplary types of processing operations can include, scaling, compositing, alpha-blending, edge detection, and so forth. In a more specific implementation, strategies are described for processing image information that is: a) linear; b) in the RGB color space; c) high precision (e.g., provided by floating point representation); d) progressive; and e) full channel. Other improvements provide strategies for: a) processing image information in a pseudo-linear space to improve processing speed; b) implementing an improved error dispersion technique; c) dynamically calculating and applying filter kernels; d) producing pipeline code in an optimal manner; and e) implementing various processing tasks using novel pixel shader techniques.

摘要翻译： 描述了以线性形式处理图像信息以减少伪像量的策略（与处理非线性形式的数据相比）。 处理操作的示例性类型可以包括缩放，合成，阿尔法混合，边缘检测等等。 在更具体的实现中，描述了用于处理图像信息的策略，其是：a）线性; b）在RGB颜色空间中; c）高精度（例如，由浮点表示提供）; d）进步; 和e）全频道。 其他改进提供了以下策略：a）在伪线性空间中处理图像信息以提高处理速度; b）实施改进的误差色散技术; c）动态计算和应用滤波器内核; d）以最佳方式生产管道代码; 以及e）使用新的像素着色器技术实现各种处理任务。

公开(公告)号：US07649539B2

公开(公告)日：2010-01-19

申请号：US10798874

申请日：2004-03-10

申请人： Glenn F. Evans ,  Stephen J. Estrop

发明人： Glenn F. Evans ,  Stephen J. Estrop

IPC分类号： G09G5/02

CPC分类号： H04N19/423 ,  H04N19/186 ,  H04N19/61

摘要： Techniques and tools for representing pixel data in a video processing or capture system are described. Described techniques and tools provide efficient color representation for video processing and capture, and provide flexibility for representing colors using different bit precisions and memory layouts. Described techniques and tools include video formats that can be used, for example, in hardware or software for capture, processing, and display purposes. In one aspect, chroma and luma information for a pixel in a video image is represented in a 16-bit fixed-point block of data having an integer and fractional components. Data can be easily converted from one representation to another (e.g., between 16-bit and 10-bit representations). In other aspects, formats for representing 8-, 10- and 16-bit video image data (e.g., packed and hybrid planar formats), and codes for indicating the formats, are described.

摘要翻译： 描述了用于在视频处理或捕获系统中表示像素数据的技术和工具。 描述的技术和工具为视频处理和捕获提供了有效的颜色表示，并提供了使用不同位精度和存储器布局表示颜色的灵活性。 所描述的技术和工具包括可用于例如用于捕获，处理和显示目的的硬件或软件中的视频格式。 在一个方面，视频图像中的像素的色度和亮度信息在具有整数和分数分量的16位定点数据块中表示。 数据可以容易地从一个表示转换到另一个表示（例如，在16位和10位表示之间）。 在其他方面，描述用于表示8,10和16位视频图像数据（例如打包和混合平面格式）的格式以及用于指示格式的代码。

公开(公告)号：US20100150441A1

公开(公告)日：2010-06-17

申请号：US12480478

申请日：2009-06-08

申请人： Glenn F. Evans ,  Stephen J. Estrop

发明人： Glenn F. Evans ,  Stephen J. Estrop

IPC分类号： G06K9/00

CPC分类号： G09G5/363 ,  G06F3/14 ,  G09G2310/0229 ,  G09G2340/0435 ,  G09G2360/125 ,  H04N7/012 ,  H04N7/0122 ,  H04N9/642 ,  H04N9/67 ,  H04N9/69

摘要： Strategies are described for processing image information using a data structure which conveys color information. The color information describes color-related formatting applied to the image information. The data structure can be passed down a video processing pipeline, where each functional component in the pipeline can draw color information from the data structure to improve the accuracy of its processing. Further, each component can supply previously unknown color information to the data structure for use by other (downstream) components in the pipeline. Exemplary fields of the data structure can include one or more of: a video transfer function field; a color primaries field; an image light field; a transfer matrix field; a nominal range field; and a video chroma sampling field. The transfer matrix field can be used to convert image information from one color space to another, such as a luma-related color space to an RGB-related color space. Processing operations can be performed on progressive and linear RGB image information.

摘要翻译： 描述了使用传达颜色信息的数据结构处理图像信息的策略。 颜色信息描述应用于图像信息的颜色相关格式。 数据结构可以沿视频处理流水线传递，其中流水线中的每个功能组件可以从数据结构中绘制颜色信息，以提高其处理的准确性。 此外，每个组件可以将以前未知的颜色信息提供给数据结构，供管道中的其他（下游）组件使用。 数据结构的示例性字段可以包括以下中的一个或多个：视频传送功能字段; 一个颜色初选字段; 图像光场; 传输矩阵域; 名义范围字段; 和视频色度采样场。 转移矩阵字段可用于将图像信息从一个颜色空间转换为另一个，例如与亮度相关的颜色空间到RGB相关的颜色空间。 可以对渐进和线性RGB图像信息执行处理操作。

公开(公告)号：US07548245B2

公开(公告)日：2009-06-16

申请号：US11851378

申请日：2007-09-06

申请人： Glenn F. Evans ,  Stephen J. Estrop

发明人： Glenn F. Evans ,  Stephen J. Estrop

IPC分类号： G09G5/02

CPC分类号： H04N19/423 ,  H04N19/186 ,  H04N19/61

摘要： Techniques and tools for representing pixel data in a video processing or capture system are described. Described techniques and tools provide efficient color representation for video processing and capture, and provide flexibility for representing colors using different bit precisions and memory layouts. Described techniques and tools include video formats that can be used, for example, in hardware or software for capture, processing, and display purposes. In one aspect, chroma and luma information for a pixel in a video image is represented in a 16-bit fixed-point block of data having an integer and fractional components. Data can be easily converted from one representation to another (e.g., between 16-bit and 10-bit representations). In other aspects, formats for representing 8-, 10- and 16-bit video image data (e.g., packed and hybrid planar formats), and codes for indicating the formats, are described.