公开(公告)号：US06996173B2

公开(公告)日：2006-02-07

申请号：US10186298

申请日：2002-06-27

申请人： Feng Wu ,  Shipeng Li ,  Xiaoyan Sun ,  Ya-Qin Zhang

发明人： Feng Wu ,  Shipeng Li ,  Xiaoyan Sun ,  Ya-Qin Zhang

IPC分类号： H04N7/12

CPC分类号： G06T9/00 ,  H04N21/234327 ,  H04N21/2402 ,  H04N21/2662

摘要： A seamless bitstream switching schema is presented. The schema takes advantage of both the high coding efficiency of non-scalable bitstreams and the flexibility of scalable bitstreams. Small bandwidth fluctuations are accommodated by the scalability of the bitstreams, while large bandwidth fluctuations are tolerated by switching among scalable bitstreams. This seamless bitstream switching schema is significantly improves the efficiency of scalable video coding over a broad range of bit rates.

摘要翻译： 提出了无缝比特流切换模式。 该模式利用了非可分级比特流的高编码效率和可扩展比特流的灵活性。 通过比特流的可扩展性来适应小的带宽波动，而通过在可缩放比特流之间切换来允许大的带宽波动。 这种无缝比特流切换模式显着地提高了广泛的比特率的可扩展视频编码的效率。

公开(公告)号：US20050147164A1

公开(公告)日：2005-07-07

申请号：US11070905

申请日：2005-03-03

申请人： Feng Wu ,  Shipeng Li ,  Ya-Qin Zhang ,  Bing Zeng ,  Xiaoyan Sun

发明人： Feng Wu ,  Shipeng Li ,  Ya-Qin Zhang ,  Bing Zeng ,  Xiaoyan Sun

IPC分类号： H04N7/26 ,  H04N7/12

CPC分类号： H04N19/34 ,  H04N19/51

摘要： A motion-compensated video encoding scheme employs progressive fine-granularity layered coding to encode macroblocks of video data into frames having multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video. Some of the enhancement layers in a current frame are predicted from different quality layers in reference frames. The video encoding scheme estimates drifting errors during the encoding and chooses a coding mode for each macroblock in the enhancement layer to maximize high coding efficiency while minimizing drifting errors.

摘要翻译： 运动补偿视频编码方案采用逐行细粒度分层编码将视频数据的宏块编码为具有多层的帧，包括具有越来越高质量视频的相对低质量视频的基本层和多个增强层。 当前帧中的一些增强层从参考帧中的不同质量层预测。 视频编码方案估计编码期间的漂移​​误差，并且为增强层中的每个宏块选择编码模式以最大化编码效率，同时最小化漂移误差。

公开(公告)号：US20050135477A1

公开(公告)日：2005-06-23

申请号：US10977590

申请日：2004-10-29

申请人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

发明人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

IPC分类号： G06T9/00 ,  H04N19/89 ,  H04N7/12

CPC分类号： H04N19/29 ,  H04N19/34 ,  H04N19/68 ,  H04N19/89

摘要： A scalable layered video coding scheme that encodes video data frames into multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video, adds error resilience to the enhancement layer. Unique resynchronization marks are inserted into the enhancement layer bitstream in headers associated with each video packet, headers associated with each bit plane, and headers associated with each video-of-plane (VOP) segment. Following transmission of the enhancement layer bitstream, the decoder tries to detect errors in the packets. Upon detection, the decoder seeks forward in the bitstream for the next known resynchronization mark. Once this mark is found, the decoder is able to begin decoding the next video packet. With the addition of many resynchronization marks within each frame, the decoder can recover very quickly and with minimal data loss in the event of a packet loss or channel error in the received enhancement layer bitstream. The video coding scheme also facilitates redundant encoding of header information from the higher-level VOP header down into lower level bit plane headers and video packet headers. Header extension codes are added to the bit plane and video packet headers to identify whether the redundant data is included.

公开(公告)号：US20050041745A1

公开(公告)日：2005-02-24

申请号：US10945011

申请日：2004-09-20

申请人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

发明人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

IPC分类号： G06T9/00 ,  H04N19/89 ,  H04N7/12

CPC分类号： H04N19/29 ,  H04N19/34 ,  H04N19/68 ,  H04N19/89

摘要： A scalable layered video coding scheme that encodes video data frames into multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video, adds error resilience to the enhancement layer. Unique resynchronization marks are inserted into the enhancement layer bitstream in headers associated with each video packet, headers associated with each bit plane, and headers associated with each video-of-plane (VOP) segment. Following transmission of the enhancement layer bitstream, the decoder tries to detect errors in the packets. Upon detection, the decoder seeks forward in the bitstream for the next known resynchronization mark. Once this mark is found, the decoder is able to begin decoding the next video packet. With the addition of many resynchronization marks within each frame, the decoder can recover very quickly and with minimal data loss in the event of a packet loss or channel error in the received enhancement layer bitstream. The video coding scheme also facilitates redundant encoding of header information from the higher-level VOP header down into lower level bit plane headers and video packet headers. Header extension codes are added to the bit plane and video packet headers to identify whether the redundant data is included.

公开(公告)号：US06816194B2

公开(公告)日：2004-11-09

申请号：US09785829

申请日：2001-02-16

申请人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

发明人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

IPC分类号： H04N718

CPC分类号： H04N19/29 ,  H04N19/34 ,  H04N19/68 ,  H04N19/89

摘要： A scalable layered video coding scheme that encodes video data frames into multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video, adds error resilience to the enhancement layer. Unique resynchronization marks are inserted into the enhancement layer bitstream in headers associated with each video packet, headers associated with each bit plane, and headers associated with each video-of-plane (VOP) segment. Following transmission of the enhancement layer bitstream, the decoder tries to detect errors in the packets. Upon detection, the decoder seeks forward in the bitstream for the next known resynchronization mark. Once this mark is found, the decoder is able to begin decoding the next video packet. With the addition of many resynchronization marks within each frame, the decoder can recover very quickly and with minimal data loss in the event of a packet loss or channel error in the received enhancement layer bitstream. The video coding scheme also facilitates redundant encoding of header information from the higher-level VOP header down into lower level bit plane headers and video packet headers. Header extension codes are added to the bit plane and video packet headers to identify whether the redundant data is included.

摘要翻译： 将视频数据帧编码成多层的可分级的分层视频编码方案，包括具有越来越高质量视频的较低质量视频和多个增强层的基本层，向增强层增加了错误恢复能力。 将独特的再同步标记插入到与每个视频分组相关联的报头中的增强层比特流中，与每个位平面相关联的报头以及与每个视频平面（VOP）段相关联的报头。 在传输增强层比特流之后，解码器尝试检测分组中的错误。 在检测到时，解码器在比特流中向前寻找下一个已知的再同步标记。 一旦找到该标记，解码器就可以开始对下一个视频数据包进行解码。 通过在每个帧内添加许多重新同步标记，解码器可以在接收到的增强层比特流中的分组丢失或信道错误的情况下非常快速地恢复并且具有最小的数据丢失。 视频编码方案还有助于将标题信息从较高级别的VOP头部冗余编码到较低级位平面头部和视频分组头部。 标题扩展码被添加到位平面和视频分组报头，以标识是否包括冗余数据。

公开(公告)号：US06501794B1

公开(公告)日：2002-12-31

申请号：US09575896

申请日：2000-05-22

申请人： Ruoyu Roy Wang ,  Hong-Jiang Zhang ,  Ya-Qin Zhang

发明人： Ruoyu Roy Wang ,  Hong-Jiang Zhang ,  Ya-Qin Zhang

IPC分类号： H04N736

CPC分类号： H04N19/90 ,  H04N19/17 ,  H04N19/48 ,  H04N19/86

摘要： A method comprising receiving media data in a compressed, digital domain, analyzing motion vectors associated with the received media content while in the compressed digital domain and identifying one or more objects in the received media data based, at least in part, on the motion vector analysis.

摘要翻译： 一种方法，包括在压缩的数字域中接收媒体数据，在压缩数字域中分析与所接收的媒体内容相关联的运动矢量，并且至少部分地基于运动矢量识别所接收的媒体数据中的一个或多个对象 分析。

公开(公告)号：US06243497B1

公开(公告)日：2001-06-05

申请号：US09022349

申请日：1998-02-11

申请人： Tihao Chiang ,  Ya-Qin Zhang

发明人： Tihao Chiang ,  Ya-Qin Zhang

IPC分类号： G06K936

CPC分类号： H04N19/587 ,  H04N19/10 ,  H04N19/115 ,  H04N19/124 ,  H04N19/129 ,  H04N19/132 ,  H04N19/146 ,  H04N19/147 ,  H04N19/152 ,  H04N19/154 ,  H04N19/172 ,  H04N19/186 ,  H04N19/196 ,  H04N19/61 ,  H04N19/63

摘要： A method and apparatus for selecting a quantizer scale for each frame to optimize the coding rate is disclosed. A quantizer scale is selected for each frame such that the target bit rate for the frame is achieved while maintaining a uniform visual quality over an entire sequence of frames.

摘要翻译： 公开了一种用于选择每帧的量化器标度以优化编码率的方法和装置。 为每个帧选择量化器标度，使得实现帧的目标比特率，同时在整个帧序列上保持均匀的视觉质量。

公开(公告)号：US07680189B2

公开(公告)日：2010-03-16

申请号：US10984159

申请日：2004-11-09

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a wavelet transform is applied to produce coefficients within different sub-bands. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，应用小波变换产生不同子带内的系数。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。

公开(公告)号：US07664185B2

公开(公告)日：2010-02-16

申请号：US10978277

申请日：2004-10-29

申请人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

发明人： Ya-Qin Zhang ,  Shipeng Li ,  Feng Wu ,  Rong Yan

IPC分类号： H04N7/18

CPC分类号： H04N19/29 ,  H04N19/34 ,  H04N19/68 ,  H04N19/89

摘要： A scalable layered video coding scheme that encodes video data frames into multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video, adds error resilience to the enhancement layer. Unique resynchronization marks are inserted into the enhancement layer bitstream in headers associated with each video packet, headers associated with each bit plane, and headers associated with each video-of-plane (VOP) segment. Following transmission of the enhancement layer bitstream, the decoder tries to detect errors in the packets. Upon detection, the decoder seeks forward in the bitstream for the next known resynchronization mark. Once this mark is found, the decoder is able to begin decoding the next video packet. With the addition of many resynchronization marks within each frame, the decoder can recover very quickly and with minimal data loss in the event of a packet loss or channel error in the received enhancement layer bitstream. The video coding scheme also facilitates redundant encoding of header information from the higher-level VOP header down into lower level bit plane headers and video packet headers. Header extension codes are added to the bit plane and video packet headers to identify whether the redundant data is included.

摘要翻译： 将视频数据帧编码成多层的可分级的分层视频编码方案，包括具有越来越高质量视频的较低质量视频和多个增强层的基本层，向增强层增加了错误恢复能力。 将独特的再同步标记插入到与每个视频分组相关联的报头中的增强层比特流中，与每个位平面相关联的报头以及与每个视频平面（VOP）段相关联的报头。 在传输增强层比特流之后，解码器尝试检测分组中的错误。 在检测到时，解码器在比特流中向前寻找下一个已知的再同步标记。 一旦找到该标记，解码器就可以开始对下一个视频数据包进行解码。 通过在每个帧内添加许多重新同步标记，解码器可以在接收到的增强层比特流中的分组丢失或信道错误的情况下非常快速地恢复并且具有最小的数据丢失。 视频编码方案还有助于将标题信息从较高级别的VOP头部冗余编码到较低级位平面头部和视频分组头部。 标题扩展码被添加到位平面和视频分组报头，以标识是否包括冗余数据。

公开(公告)号：US07653134B2

公开(公告)日：2010-01-26

申请号：US10901740

申请日：2004-07-29

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。