公开(公告)号：US06263022B1

公开(公告)日：2001-07-17

申请号：US09347882

申请日：1999-07-06

申请人： Yingwei Chen ,  Hayder Radha ,  Mihaela van der Schaar

发明人： Yingwei Chen ,  Hayder Radha ,  Mihaela van der Schaar

IPC分类号： H04N712

CPC分类号： H04N19/34 ,  H04N19/126 ,  H04N19/29

摘要： There is disclosed an adaptive quantization controller for use in a video encoder comprising a base layer circuit for receiving an input stream of video frames and generating compressed base layer video frames suitable for transmission to a streaming video receiver and an enhancement layer circuit for receiving the input stream of video frames and a decoded version of the compressed base layer video frames and generating enhancement layer video data associated with, and allocated to, corresponding ones of the compressed base layer video frames. The adaptive quantization controller receives at least one quantization parameter from the base layer circuit and, in response thereto, determines a corresponding shifting factor for shifting a bit plane associated with the enhancement layer video data. The adaptive quantizaion controller also modifies a data field in the enhancement layer video data to cause the video streaming receiver to assign a higher decoding priority to the shifted bit plane.

摘要翻译： 公开了一种在视频编码器中使用的自适应量化控制器，其包括用于接收视频帧的输入流的基本层电路，并且生成适合于传输到流式视频接收机的压缩基本层视频帧以及用于接收输入的增强层电路 视频帧流和压缩基本层视频帧的解码版本，并且生成与压缩基本层视频帧相关联并分配给对应的压缩基本层视频帧的增强层视频数据。 自适应量化控制器从基层电路接收至少一个量化参数，响应于此，确定用于移位与增强层视频数据相关联的比特平面的相应移位因子。 自适应量化控制器还修改增强层视频数据中的数据字段，以使视频流接收机向移位的位平面分配更高的解码优先级。

公开(公告)号：US06788740B1

公开(公告)日：2004-09-07

申请号：US09411464

申请日：1999-10-01

申请人： Mihaela van der Schaar ,  Yingwei Chen ,  Hayder Radha

发明人： Mihaela van der Schaar ,  Yingwei Chen ,  Hayder Radha

IPC分类号： H04B166

CPC分类号： H04N19/34 ,  H04N19/13 ,  H04N19/29 ,  H04N19/61 ,  H04N19/63

摘要： There is disclosed a video encoder comprising a base layer encoder and an enhancement layer encoder. The base layer encoder receives an input stream of video frames and generates compressed base layer video data suitable for transmission to a streaming video receiver. The enhancement layer encoder receives the input stream of video frames and a decoded version of the compressed base layer video data and generates enhancement layer video data associated with the compressed base layer video data and suitable for transmission to the streaming video receiver. The video encoder also comprises a controller associated with the enhancement layer circuitry for receiving a quantization parameter associated with the base layer video data and determining therefrom at least one all-zero bit plane associated with at least one block of the enhancement layer video data. The controller is capable of causing the enhancement layer circuitry not to transmit the at least one all-zero bit plane to the streaming video receiver.

摘要翻译： 公开了一种包括基本层编码器和增强层编码器的视频编码器。 基层编码器接收视频帧的输入流，并产生适合于传输到流式视频接收机的压缩基本层视频数据。 增强层编码器接收视频帧的输入流和压缩基本层视频数据的解码版本，并且生成与压缩基本层视频数据相关联并适于传输到流视频接收器的增强层视频数据。 视频编码器还包括与增强层电路相关联的控制器，用于接收与基本层视频数据相关联的量化参数，并从中确定与增强层视频数据的至少一个块相关联的至少一个全零位平面。 控制器能够使增强层电路不将至少一个全零位平面发送到流视频接收器。

公开(公告)号：US06501797B1

公开(公告)日：2002-12-31

申请号：US09347881

申请日：1999-07-06

申请人： Mihaela van der Schaar ,  Yingwei Chen ,  Hayder Radha

发明人： Mihaela van der Schaar ,  Yingwei Chen ,  Hayder Radha

IPC分类号： H04B1404

CPC分类号： H04N19/34 ,  H04N19/103 ,  H04N19/137 ,  H04N19/146 ,  H04N19/187 ,  H04N19/29 ,  H04N19/33 ,  H04N19/37

摘要： There is disclosed an apparatus for controlling the transmission of enhancement layer video data for use in a video encoder containing a base layer encoder and an enhancement layer encoder. The base layer encoder receives input video frames and generates compressed base layer video frames suitable for transmission at a base layer bit rate to a streaming video receiver. The enhancement layer encoder compares the input video frames and a processed version of the compressed base layer video frames and generates enhancement layer video data suitable for transmission at a modifiable enhancement layer bit rate to the streaming video receiver. The apparatus comprises a base layer parameter monitor for receiving at least one base layer parameter and, in response thereto, modifying an allocation of the enhancement layer video data among corresponding ones of the compressed base layer video frames.

摘要翻译： 公开了一种用于控制在包含基本层编码器和增强层编码器的视频编码器中使用的增强层视频数据的传输的装置。 基层编码器接收输入视频帧，并产生适合于以基层比特率传输的压缩基层视频帧到流视频接收机。 增强层编码器比较输入视频帧和经压缩的基本层视频帧的处理版本，并生成适于以可修改的增强层比特率传输到流式视频接收机的增强层视频数据。 该装置包括用于接收至少一个基本层参数的基本层参数监视器，并且响应于此，在相应的压缩基本层视频帧中修改增强层视频数据的分配。

公开(公告)号：US07042944B2

公开(公告)日：2006-05-09

申请号：US09887756

申请日：2001-06-21

申请人： Mihaela van der Schaar ,  Hayder Radha

发明人： Mihaela van der Schaar ,  Hayder Radha

IPC分类号： H04N7/00

CPC分类号： H04N19/34 ,  H04N19/31 ,  H04N19/61

摘要： A video coding technique having motion compensation for bi-directional predicted frames (B-frames) and predicted frames (P-frames). The video coding technique involves a single-loop prediction-based base layer which includes base layer B- and/or P-frames that are generated from “extended” or “enhanced” base layer reference frames during base layer coding.

公开(公告)号：US06785334B2

公开(公告)日：2004-08-31

申请号：US09930671

申请日：2001-08-15

申请人： Mihaela van der Schaar ,  Hayder Radha

发明人： Mihaela van der Schaar ,  Hayder Radha

IPC分类号： H04N712

CPC分类号： H04N19/34 ,  H04N19/29 ,  H04N19/31 ,  H04N19/33

摘要： In a Fine Granular Video encoding system, a method for determining the number of transmission bits of SNR encoded and temporally encoded video data within a frame to balance image quality and object motion is presented. In accordance with the principles of the invention, a number of transmission bits at a known bit-rate for a quality enhanced video frame and a temporal enhanced video frame is determined to balance image quality and object motion smoothness. In one aspect of the invention, the number of bits transmitted in each frame is determined by comparing a ratio of a measure of video encoded information within the quality enhanced video frame and a measure of video encode information within the quality enhanced video frame and the temporally enhanced video frame to a known threshold level. The number of transmission bits in each enhancement layer is then determined using a first method when the ratio is above a known threshold and using a second method otherwise. In a second aspect of the invention, the number of bits is determined by first determining a measure of motion activity and complexity. The number of transmission bits is determined using a first method when the motion activity is below a known measure or the complexity if above a known threshold. Otherwise a second method is used to determine the number of transmission bits in each enhancement layer.

摘要翻译： 在精细粒度视频编码系统中，提出了一种用于确定帧内的SNR编码和时间编码视频数据的传输比特数以平衡图像质量和对象运动的方法。 根据本发明的原理，确定了用于质量增强视频帧和时间增强视频帧的已知比特率的多个传输比特以平衡图像质量和对象运动平滑度。 在本发明的一个方面，通过比较质量增强视频帧内的视频编码信息的度量与质量增强视频帧内的视频编码信息的度量和时间上的比较来确定每帧中发送的位数 增强视频帧到已知的阈值级别。 然后当比率高于已知阈值时使用第一种方法来确定每个增强层中的传输比特数，否则使用第二种方法。 在本发明的第二方面，通过首先确定运动活动和复杂度的度量来确定比特数。 当运动活动低于已知测量时，使用第一种方法来确定传输比特数，或者如果高于已知阈值，则确定复杂度。 否则，使用第二种方法来确定每个增强层中的传输比特数。

公开(公告)号：US20060262718A1

公开(公告)日：2006-11-23

申请号：US10547714

申请日：2003-09-01

申请人： Qiong Li ,  Mihaela van der Schaar

发明人： Qiong Li ,  Mihaela van der Schaar

IPC分类号： H04L12/26

CPC分类号： H04L47/10 ,  H04L1/0015 ,  H04L1/1825 ,  H04L1/1887 ,  H04L47/11 ,  H04L47/14 ,  H04L47/2416 ,  H04W24/00 ,  H04W28/14 ,  H04W28/18 ,  H04W84/12

摘要： This invention provides a system and method to dynamically adapt a wireless link retry limit in real-time according to channel conditions and workload intensity in order to maximize MAC throughput and minimize packet loss. In wireless local area networks (WLANs), such as IEEE 802.11b or a, packets can get lost due to either link error or interface queue overflow. Retry is deployed by a wireless link as a link error protection mechanism to reduce packet loss due to link error. However, an improper configuration of this retry limit (such as too high) may cause more packet loss due to queue overflow than link error. The retry-limit adaptation system and method of this invention strikes a balance between queue drops and link losses. Consequently, it achieves much better network performance in terms of a significant reduction of overall packet loss when compared with situations where the retry limit is statically configured, as recommended by the current standard. For video applications, this dynamic adaptation can be configured in such a way that the video quality for a particular network condition is optimized.

摘要翻译： 本发明提供一种根据信道条件和工作负载强度实时动态地适应无线链路重试限制的系统和方法，以便最大化MAC吞吐量并最小化分组丢失。 在诸如IEEE 802.11b或a之类的无线局域网（WLAN）中，由于链路错误或接口队列溢出，数据包可能会丢失。 重试由无线链路部署为链路错误保护机制，以减少链路错误引起的丢包。 但是，由于队列溢出而导致的重试限制（如太高）的配置不正确会导致链路错误导致更多的丢包。 本发明的重试限制适配系统和方法在队列丢弃和链路丢失之间达成平衡。 因此，根据当前标准的推荐，与静态配置重试限制的情况相比，在整体分组丢失显着减少方面，实现了更好的网络性能。 对于视频应用，可以以这样的方式配置该动态适配，使得针对特定网络条件的视频质量被优化。

公开(公告)号：US20060008000A1

公开(公告)日：2006-01-12

申请号：US10531195

申请日：2003-10-08

申请人： Jong Ye ,  Mihaela van der Schaar

发明人： Jong Ye ,  Mihaela van der Schaar

IPC分类号： H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/1883 ,  H04N19/523 ,  H04N19/547 ,  H04N19/61 ,  H04N19/63 ,  H04N19/635

摘要： A method and device for coding video where a video signal is spatially decomposed into at least two signals of different frequency sub-bands, an individualized motion compensated temporal filtering scheme is applied to each sub-band signal adaptively according to signal contents, and texture coding is applied to each of the motion compensated temporally filtered subband signals adaptively according to the signal content.

摘要翻译： 一种将视频信号在空间上分解为不同频率子带的至少两个信号的视频编码的方法和装置，根据信号内容自适应地对每个子带信号应用个性化运动补偿时间滤波方案，并且纹理编码 根据信号内容自适应地应用于每个运动补偿时间滤波的子带信号。

公开(公告)号：US06909753B2

公开(公告)日：2005-06-21

申请号：US10011997

申请日：2001-12-05

申请人： Joseph Meehan ,  Mihaela van der Schaar

发明人： Joseph Meehan ,  Mihaela van der Schaar

IPC分类号： H04N7/26 ,  G06T9/00 ,  H03M7/30 ,  H03M13/35 ,  H04N7/50 ,  H04N7/64 ,  H04N7/66 ,  H04N19/89 ,  H04N21/2343 ,  H04N21/2383 ,  H04N21/2662 ,  H04N21/438 ,  H04N21/4402 ,  H04N21/6377 ,  H04N21/647 ,  H04N21/658 ,  H04N7/12

CPC分类号： H04N21/234327 ,  H04N19/34 ,  H04N19/61 ,  H04N19/67 ,  H04N19/89 ,  H04N21/2662 ,  H04N21/43637 ,  H04N21/440227 ,  H04N21/4621 ,  H04N21/6131 ,  H04N21/6379

摘要： The invention relates to a method and system for modulating an MPEG-4 FGS compressed video stream for variable-bandwidth transmission. A source of a video stream is provided, and a display having means for generating a control input signal for controlling one or more of video compression, error correction code generation, or symbol constellation mapping. The source video stream is compressed using MPEG-4 FGS compression to generate a compressed output video stream. The video compression is optionally performed based upon the control input signal from the display. Error correction code for the compressed video stream may be added, and its generation and addition may be optionally controlled based upon the control input signal from the display. The resulting video symbols may then be mapped to constellations, with this mapping also optionally controlled based upon the control input signal. The resulting compressed output video stream is then transmitted to the display.

摘要翻译： 本发明涉及用于调制用于可变带宽传输的MPEG-4FGS压缩视频流的方法和系统。 提供视频流的源，并且显示器具有用于产生用于控制视频压缩，纠错码生成或符号星座映射中的一个或多个的控制输入信号的装置。 使用MPEG-4FGS压缩来压缩源视频流以产生压缩的输出视频流。 可选地，基于来自显示器的控制输入信号执行视频压缩。 可以添加用于压缩视频流的纠错码，并且可以根据来自显示器的控制输入信号任意地控制其生成和添加。 所得到的视频符号然后可以被映射到星座，该映射也可以基于控制输入信号任选地被控制。 然后将所产生的压缩输出视频流发送到显示器。

公开(公告)号：US06895055B2

公开(公告)日：2005-05-17

申请号：US10039686

申请日：2001-10-29

申请人： Shaomin Peng ,  Mihaela van der Schaar

发明人： Shaomin Peng ,  Mihaela van der Schaar

IPC分类号： H04N7/30 ,  G06T9/00 ,  H04N7/26 ,  H04N7/12 ,  H04N11/02

CPC分类号： H04N19/34

摘要： A system and method for generating a frequency weighted (FW) matrix for use in a Fine-Granularity-Scalability (FGS) video coding system. The system comprises: a system for plotting the average discrete cosine transform (DCT) residuals versus the zigzag DCT scan line locations for a sample video frame encoded both at a predetermined base layer bit-rate and at approximately three times the predetermined base layer bit-rate; a system for generating the difference plot of DCT residuals versus the zigzag DCT scan line locations for the video frame encoded at both the predetermined base layer bit-rate and at approximately three times the predetermined base layer bit-rate; and a system for matching and normalizing a staircase curve to the average difference plot, wherein the staircase curve values can be further mapped into the weights for the FW matrix.

摘要翻译： 一种用于生成用于精细粒度可扩展性（FGS）视频编码系统的频率加权（FW）矩阵的系统和方法。 该系统包括：用于绘制平均离散余弦变换（DCT）残差相对于以预定基本层比特率编码的样本视频帧的锯齿形DCT扫描线位置和大约三倍于预定基本层比特率的系统， 率; 用于产生DCT残差与针对预定基本层比特率和大约三倍于预定基本层比特率编码的视频帧的之字形DCT扫描线位置的差分图的系统; 以及用于将阶梯曲线匹配和归一化为平均差分图的系统，其中，阶梯曲线值可以进一步映射到FW矩阵的权重中。

公开(公告)号：US06680973B2

公开(公告)日：2004-01-20

申请号：US09821140

申请日：2001-03-29

申请人： Shaomin Peng ,  Mihaela van der Schaar

发明人： Shaomin Peng ,  Mihaela van der Schaar

IPC分类号： H04N712

CPC分类号： H04N19/577 ,  H04N19/137 ,  H04N19/156 ,  H04N19/503 ,  H04N19/61 ,  H04N19/90

摘要： A decoder system having a motion compensation system that scales the processing of B pictures in order to save computational resources. The motion compensation system has a first scaling system that includes comparing a motion vector magnitude of each macroblock in a B picture with a predetermined threshold. A system for performing a routine decoding operation for each macroblock in which the motion vector magnitude is greater than the predetermined threshold and a system for copying a corresponding macroblock from a previous picture for each macroblock in which the motion vector magnitude is less than or equal to the predetermined threshold. A second scaling system that includes calculating an average motion vector magnitude for a first B picture and replacing a next contiguous B picture with the first B picture if the average motion vector magnitude is less than or equal to a predetermined threshold.

摘要翻译： 一种具有运动补偿系统的解码器系统，其对B图像的处理进行缩放以节省计算资源。 运动补偿系统具有第一缩放系统，其包括将B图像中的每个宏块的运动矢量幅度与预定阈值进行比较。 一种用于对其中运动矢量幅度大于预定阈值的每个宏块执行例程解码操作的系统以及用于从运动矢量幅度小于或等于的每个宏块的前一图像复制相应宏块的系统 预定阈值。 第二缩放系统，包括如果平均运动矢量幅度小于或等于预定阈值，则计算第一B图像的平均运动矢量幅值并用第一B图像代替下一连续B图像。