公开(公告)号：US06594798B1

公开(公告)日：2003-07-15

申请号：US09316696

申请日：1999-05-21

申请人： Philip A. Chou ,  Albert S. Wang ,  Sanjeev Mehrotra ,  Alexander E. Mohr

发明人： Philip A. Chou ,  Albert S. Wang ,  Sanjeev Mehrotra ,  Alexander E. Mohr

IPC分类号： G06F702

CPC分类号： H04L1/0059 ,  H04L1/0002 ,  H04L1/06 ,  H04L1/08

摘要： Correction of errors and losses in a receiver-driven layered multicast (RLM) of real-time media over a network is augmented using one or more layers of error correction information. Each receiver separately optimizes the quality of received information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM has one or more associated multicasted error correction data streams. Each error correction layer contains information for replacing lost packets from the associated source layer. More than one error correction layer is proposed to correct for lost packets in other error correction layers. Error correction streams are preferably generated using a pseudo-Automatic Repeat Request (ARQ) wherein a broadcaster sends both the source packets in a primary stream and delayed versions thereof in one or more redundant streams. A hybrid technique combines the psuedo-ARQ method with an adaptation of Forward Error Correction (FEC) techniques.

摘要翻译： 使用一层或多层纠错信息来增强网络中实时媒体的接收机驱动的分层多播（RLM）中的错误和损失的校正。 每个接收器通过订阅至少一个纠错层分别优化接收信息的质量。 理想地，RLM中的每个源层具有一个或多个关联的多播纠错数据流。 每个纠错层包含用于替换相关源层丢失数据包的信息。 提出了多个纠错层来纠正其他纠错层中的丢包。 优选地，使用伪自动重传请求（ARQ）生成错误校正流，其中广播者在一个或多个冗余流中发送主流中的源分组和其延迟版本。 混合技术将伪秩ARQ方法与前向纠错（FEC）技术相结合。

公开(公告)号：US06996097B1

公开(公告)日：2006-02-07

申请号：US09315810

申请日：1999-05-21

申请人： Philip A. Chou ,  Albert S. Wang ,  Sanjeev Mehrotra ,  Alexander E. Mohr

发明人： Philip A. Chou ,  Albert S. Wang ,  Sanjeev Mehrotra ,  Alexander E. Mohr

IPC分类号： H04L12/56

CPC分类号： H04L1/007 ,  H04L1/0009 ,  H04L1/0017 ,  H04L1/06 ,  H04L1/1812 ,  H04L2001/0093

摘要： A system and method for correcting errors and losses occurring during a receiver-driven layered multicast (RLM) of real-time media over a heterogeneous packet network such as the Internet. This is accomplished by augmenting RLM with one or more layers of error correction information. This allows each receiver to separately optimize the quality of received audio and video information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM would have one or more multicasted error correction data streams (i.e., layers) associated therewith. Each of the error correction layers would contain information that can be used to replace lost packets from the associated source layer. More than one error correction layer is proposed as some of the error correction packets contained in the data stream needed to replace the packets lost in the associated source stream may themselves be lost in transmission. A preferred process for generating the error correction streams involves the use of a unique adaptation of the Forward Error Correction (FEC) techniques. This process encodes the transmission data using a linear transform which adds redundant elements. The redundancy permits losses to be corrected because any of the original data elements can be derived from any of the encoded elements. Thus, as long as enough of the encoded data elements are received so as to equal the number of the original data elements, it is possible to derive all the original elements.

摘要翻译： 一种用于在异构分组网络（例如因特网）下校正在实时媒体的接收机驱动分层多播（RLM）期间发生的错误和损失的系统和方法。 这是通过用一层或多层纠错信息增强RLM来实现的。 这允许每个接收机通过订阅至少一个纠错层来分别优化所接收的音频和视频信息的质量。 理想地，RLM中的每个源层将具有与其相关联的一个或多个多播的纠错数据流（即，层）。 每个纠错层将包含可用于替换相关源层丢失的分组的信息。 提出了多于一个纠错层，因为包含在替换相关源流中丢失的分组所需的数据流中的一些纠错分组本身可能在传输中丢失。 用于产生纠错流的优选过程涉及使用前向纠错（FEC）技术的唯一适配。 该过程使用添加冗余元素的线性变换对传输数据进行编码。 冗余允许修正损失，因为任何原始数据元素可以从任何编码元素导出。 因此，只要接收到足够的编码数据元素以便等于原始数据元素的数量，就有可能导出所有的原始元素。

公开(公告)号：US06532562B1

公开(公告)日：2003-03-11

申请号：US09316869

申请日：1999-05-21

申请人： Philip A. Chou ,  Albert S. Wang ,  Sanjeev Mehrotra

发明人： Philip A. Chou ,  Albert S. Wang ,  Sanjeev Mehrotra

IPC分类号： G06F1100

CPC分类号： H04L1/0059 ,  H04L1/0002 ,  H04L1/06 ,  H04L1/08

摘要： “Correction of errors and losses occurring during a receiver-driven layered multicast (RLM) of real-time media over a heterogeneous packet network such as the Internet is accomplished by augmenting RLM with one or more layers of error correction information. Each receiver separately optimizes the quality of received audio and video information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM would have one or more associated multicasted error correction data streams (i.e., layers). Each error correction layer contains information that can be used to replace lost packets from the associated source layer. More than one error correction layer is proposed as some of the error correction packets contained in the data stream needed to replace the packets lost in the associated source stream may themselves be lost in transmission.”

摘要翻译： 通过异构分组网络（如Internet）的实时媒体接收机驱动分层多播（RLM）中发生的错误和损失的纠正是通过用一层或多层纠错信息增强RLM来实现的，每个接收机分别优化 通过订阅至少一个纠错层，接收的音频和视频信息的质量理想地，RLM中的每个源层将具有一个或多个关联的多播纠错数据流（即，层），每个纠错层包含 可以使用来自相关源层的丢失分组来替代不止一个纠错层，因为包含在数据流中的一些纠错分组被包含在替换相关源流中丢失的分组所需的数据流本身可能在传输中丢失 “。

公开(公告)号：US06470469B1

公开(公告)日：2002-10-22

申请号：US09276842

申请日：1999-03-26

申请人： Philip A. Chou ,  Sanjeev Mehrotra ,  Albert S. Wang

发明人： Philip A. Chou ,  Sanjeev Mehrotra ,  Albert S. Wang

IPC分类号： H03M1300

CPC分类号： H03M13/35 ,  G06T5/005 ,  G06T5/10 ,  G06T2207/20052 ,  G06T2207/20056 ,  H03M13/03 ,  H03M13/17

摘要： A projection onto convex sets (POCS)-based method for consistent reconstruction of a signal from a subset of quantized coefficients received from an N×K overcomplete transform. By choosing a frame operator F to be the concatenization of two or more K×K invertible transforms, the POCS projections are calculated in RK space using only the K×K transforms and their inverses, rather than the larger RN space using pseudo inverse transforms. Practical reconstructions are enabled based on, for example, wavelet, subband, or lapped transforms of an entire image. In one embodiment, unequal error protection for multiple description source coding is provided. In particular, given a bit-plane representation of the coefficients in an overcomplete representation of the source, one embodiment of the present invention provides coding the most significant bits with the highest redundancy and the least significant bits with the lowest redundancy. In one embodiment, this is accomplished by varying the quantization stepsize for the different coefficients. Then, the available received quantized coefficients are decoded using a method based on alternating projections onto convex sets.

摘要翻译： 基于凸集（POCS）的方法的投影，用于从从NxK过完全变换接收的量化系数的子集的信号的一致重构。 通过选择一个帧运算符F作为两个或多个KxK可逆变换的并置，POCS投影在RK空间中仅使用KxK变换及其反转而不是使用伪逆变换的较大的RN空间来计算。 基于例如整个图像的小波，子带或重叠变换来实现实际重建。 在一个实施例中，提供了用于多描述源编码的不等差错保护。 特别地，给定源的过完整表示中的系数的位平面表示，本发明的一个实施例提供了具有最高冗余度的最高有效位和具有最低冗余度的最低有效位的编码。 在一个实施例中，这通过改变不同系数的量化步长来实现。 然后，使用基于在凸集上的交替投影的方法对可用的接收量化系数进行解码。

公开(公告)号：US06460153B1

公开(公告)日：2002-10-01

申请号：US09276955

申请日：1999-03-26

申请人： Philip A. Chou ,  Sanjeev Mehrotra ,  Albert S. Wang

发明人： Philip A. Chou ,  Sanjeev Mehrotra ,  Albert S. Wang

IPC分类号： H03M1300

CPC分类号： H04N19/89

摘要： A projection onto convex sets (POCS)-based method for consistent reconstruction of a signal from a subset of quantized coefficients received from an N×K overcomplete transform. By choosing a frame operator F to be the concatenization of two or more K×K invertible transforms, the POCS projections are calculated in RK space using only the K×K transforms and their inverses, rather than the larger RN space using pseudo inverse transforms. Practical reconstructions are enabled based on, for example, wavelet, subband, or lapped transforms of an entire image. In one embodiment, unequal error protection for multiple description source coding is provided. In particular, given a bit-plane representation of the coefficients in an overcomplete representation of the source, one embodiment of the present invention provides coding the most significant bits with the highest redundancy and the least significant bits with the lowest redundancy. In one embodiment, this is accomplished by varying the quantization stepsize for the different coefficients. Then, the available received quantized coefficients are decoded using a method based on alternating projections onto convex sets.

摘要翻译： 基于凸集（POCS）的方法的投影，用于从从NxK过完全变换接收的量化系数的子集的信号的一致重构。 通过选择一个帧运算符F作为两个或多个KxK可逆变换的并置，POCS投影在RK空间中仅使用KxK变换及其反转而不是使用伪逆变换的较大的RN空间来计算。 基于例如整个图像的小波，子带或重叠变换来实现实际重建。 在一个实施例中，提供了用于多描述源编码的不等差错保护。 特别地，给定源的过完整表示中的系数的位平面表示，本发明的一个实施例提供了具有最高冗余度的最高有效位和具有最低冗余度的最低有效位的编码。 在一个实施例中，这通过改变不同系数的量化步长来实现。 然后，使用基于在凸集上的交替投影的方法对可用的接收量化系数进行解码。

公开(公告)号：US06571016B1

公开(公告)日：2003-05-27

申请号：US08850957

申请日：1997-05-05

申请人： Sanjeev Mehrotra ,  Albert S. Wang

发明人： Sanjeev Mehrotra ,  Albert S. Wang

IPC分类号： G06K936

CPC分类号： H04N19/119 ,  H03M7/3082 ,  H04N19/10 ,  H04N19/115 ,  H04N19/146 ,  H04N19/147 ,  H04N19/19 ,  H04N19/48 ,  H04N19/51 ,  H04N19/593 ,  H04N19/60 ,  H04N19/61 ,  H04N19/63 ,  H04N19/90 ,  H04N19/94 ,  H04N19/96

摘要： An apparatus and method for encoding video frames is provided. The video frames are divided into blocks for encoding. Encoding of the video blocks utilizes motion detection, motion estimation and adaptive compression, to obtain the desired compression for a particular bit rate. Adaptive compression includes intra compression (without regard to other frames) and inter compression (with regard to other frames). Intra compression, inter compression with motion detection, and inter compression with motion estimation are performed on a block by block basis, as needed. Segmentation is provided to compare encoding of a block with encoding of its sub-blocks, and to select the best block size for encoding.

摘要翻译： 提供了一种用于编码视频帧的装置和方法。 视频帧被分成块进行编码。 视频块的编码利用运动检测，运动估计和自适应压缩，以获得针对特定比特率的期望的压缩。 自适应压缩包括帧内压缩（不考虑其他帧）和帧间压缩（关于其他帧）。 根据需要逐块地执行内部压缩，具有运动检测的帧间压缩和具有运动估计的帧间压缩。 提供分段以比较块的编码与其子块的编码，并选择用于编码的最佳块大小。

公开(公告)号：US07162091B2

公开(公告)日：2007-01-09

申请号：US10403780

申请日：2003-03-31

申请人： Albert S. Wang ,  Sanjeev Mehrotra

发明人： Albert S. Wang ,  Sanjeev Mehrotra

IPC分类号： G06K9/36 ,  G06K9/46

CPC分类号： H03M7/3082 ,  H04N19/10 ,  H04N19/115 ,  H04N19/146 ,  H04N19/147 ,  H04N19/19 ,  H04N19/48 ,  H04N19/593 ,  H04N19/60 ,  H04N19/61 ,  H04N19/63 ,  H04N19/90 ,  H04N19/94 ,  H04N19/96

摘要： An apparatus and method for encoding video frames is provided. The video frames are divided into blocks for encoding. Encoding of the video blocks utilizes motion detection, motion estimation and adaptive compression, to obtain the desired compression for a particular bit rate. Adaptive compression includes intra compression (without regard to other frames) and inter compression (with regard to other frames). Intra compression, inter compression with motion detection, and inter compression with motion estimation are performed on a block by block basis, as needed. Segmentation is provided to compare encoding of a block with encoding of its sub-blocks, and to select the best block size for encoding.

摘要翻译： 提供了一种用于编码视频帧的装置和方法。 视频帧被分成块进行编码。 视频块的编码利用运动检测，运动估计和自适应压缩，以获得针对特定比特率的期望的压缩。 自适应压缩包括帧内压缩（不考虑其他帧）和帧间压缩（关于其他帧）。 根据需要逐块地执行内部压缩，具有运动检测的帧间压缩和具有运动估计的帧间压缩。 提供分段以比较块的编码与其子块的编码，并选择用于编码的最佳块大小。

公开(公告)号：US07181072B2

公开(公告)日：2007-02-20

申请号：US10403962

申请日：2003-03-31

申请人： Albert S. Wang ,  Sanjeev Mehrotra

发明人： Albert S. Wang ,  Sanjeev Mehrotra

IPC分类号： G06K9/36 ,  G06K9/46

CPC分类号： H04N19/119 ,  H03M7/3082 ,  H04N19/10 ,  H04N19/115 ,  H04N19/146 ,  H04N19/147 ,  H04N19/19 ,  H04N19/48 ,  H04N19/51 ,  H04N19/593 ,  H04N19/60 ,  H04N19/61 ,  H04N19/63 ,  H04N19/90 ,  H04N19/94 ,  H04N19/96

摘要： An apparatus and method for encoding video frames is provided. The video frames are divided into blocks for encoding. Encoding of the video blocks utilizes motion detection, motion estimation and adaptive compression, to obtain the desired compression for a particular bit rate. Adaptive compression includes intra compression (without regard to other frames) and inter compression (with regard to other frames). Intra compression, inter compression with motion detection, and inter compression with motion estimation are performed on a block by block basis, as needed. Segmentation is provided to compare encoding of a block with encoding of its sub-blocks, and to select the best block size for encoding.

公开(公告)号：US07391912B2

公开(公告)日：2008-06-24

申请号：US11173279

申请日：2005-07-01

申请人： Albert S. Wang

发明人： Albert S. Wang

IPC分类号： G06K9/36

CPC分类号： H03M7/4006 ,  G06F12/0875 ,  H04N1/64 ,  H04N19/182 ,  H04N19/593 ,  H04N19/91

摘要： An adaptive entropy coder is coupled with a localized conditioning context to provide efficient compression of images with localized high frequency variations. In one implementation, an arithmetic coder can be used as the adaptive entropy coder. The localized conditioning context includes a basic context region with multiple context pixels that are adjacent the current pixel, each of the context pixels having an image tone. A state is determined for the basic context region based upon a pattern of unique image tones among the context pixels therein. An extended context region that includes the basic context region is used to identify a non-local trend within the context pixels and a corresponding state. A current pixel may be arithmetically encoded according to a previously encoded pixel having the same tone or as a not-in-context element. In one implementation, a not-in-context element may be represented by a tone in a color cache that is arranged as an ordered list of most recent not-in-context values.

摘要翻译： 自适应熵编码器与局部调节上下文相结合，以提供具有局部高频变化的图像的有效压缩。 在一个实现中，可以使用算术编码器作为自适应熵编码器。 局部调节上下文包括具有与当前像素相邻的多个上下文像素的基本上下文区域，每个上下文像素具有图像色调。 基于其中的上下文像素之间的唯一图像色调的图案，为基本上下文区域确定状态。 包括基本上下文区域的扩展上下文区域用于识别上下文像素内的非局部趋势和相应的状态。 当前像素可以根据具有相同色调的先前编码的像素或不在上下文内容进行算术编码。 在一个实施方式中，不在上下文内容的元素可以由布置为最近的不在上下文值的有序列表的颜色高速缓存中的色调来表示。

公开(公告)号：US06707852B1

公开(公告)日：2004-03-16

申请号：US09653124

申请日：2000-08-31

申请人： Albert S. Wang

发明人： Albert S. Wang

IPC分类号： H04N712

CPC分类号： H04N19/19 ,  H04N19/114 ,  H04N19/126 ,  H04N19/137 ,  H04N19/142 ,  H04N19/147 ,  H04N19/172 ,  H04N19/177 ,  H04N19/179

摘要： A motion video signal encoder maximizes image quality without exceeding transmission bandwidth available to carry the encoded motion video signal by comparing encoded frames of the motion video signal to a desired size of frame. If the size of encoded frames differ from the desired size, encoding is adjusted to produce encoded frames closer in size to the desired size. In addition, a cumulative bandwidth error records an accumulated amount of available bandwidth. The cumulative bandwidth error is adjusted as time elapses to add to the available bandwidth and as each frame is encoded to thereby consume bandwidth. As the cumulative bandwidth error grows in magnitude above or below zero, encoding is adjusted as needed to either improve image quality to more completely consume available bandwidth or to reduce image quality to thereby consume less bandwidth and to thereby cause the cumulative bandwidth error to move toward zero. Rapid changes in the amount of change or motion in the motion video signal are detected by comparing the amount of change between two consecutive frames and filtering the amount of change with previously measured amounts of change. Encoding is pre-compensated according to the filtered measurement of rapid change.

摘要翻译： 运动视频信号编码器通过将运动视频信号的编码帧与期望的帧大小进行比较，使图像质量最大化，而不超过可用于携带编码运动视频信号的传输带宽。 如果编码帧的大小与期望的大小不同，则调整编码以产生尺寸更接近所需大小的编码帧。 此外，累积带宽误差记录可用带宽的累积量。 随着时间的推移，累积带宽误差被调整以增加可用带宽，并且每个帧被编码从而消耗带宽。 随着累积带宽误差在零度以上或低于零的幅度增长，根据需要调整编码以提高图像质量，以更完全地消耗可用带宽或降低图像质量，从而消耗更少的带宽，从而导致累积带宽误差向 零。 通过比较两个连续帧之间的变化量并用先前测量的变化量滤除变化量来检测运动视频信号中变化量或运动量的快速变化。 编码根据过滤的快速变化测量进行预补偿。