公开(公告)号：US07680189B2

公开(公告)日：2010-03-16

申请号：US10984159

申请日：2004-11-09

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a wavelet transform is applied to produce coefficients within different sub-bands. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，应用小波变换产生不同子带内的系数。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。

公开(公告)号：US07653134B2

公开(公告)日：2010-01-26

申请号：US10901740

申请日：2004-07-29

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。

公开(公告)号：US07680190B2

公开(公告)日：2010-03-16

申请号：US10984467

申请日：2004-11-09

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。

公开(公告)号：US07023922B1

公开(公告)日：2006-04-04

申请号：US09599160

申请日：2000-06-21

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients: In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数：特别地，基于前一帧，当前帧和下一帧中相邻采样的重要性，系数被分配各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。

公开(公告)号：US20050002457A1

公开(公告)日：2005-01-06

申请号：US10901621

申请日：2004-07-29

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N7/26

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。

公开(公告)号：US20050094731A1

公开(公告)日：2005-05-05

申请号：US10984467

申请日：2004-11-09

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N7/26

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。

公开(公告)号：US06795504B1

公开(公告)日：2004-09-21

申请号：US09599807

申请日：2000-06-21

申请人： Jizheng Xu ,  Shipeng Li ,  Zixiang Xiong ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Zixiang Xiong ,  Ya-Qin Zhang

IPC分类号： H04N712

CPC分类号： H04N19/61 ,  H04N19/102 ,  H04N19/63

摘要： A video coding system and method utilizes a 3-D wavelet transform that is memory efficient and reduces boundary effect across frame boundaries. The transform employs a lifting-based scheme and buffers wavelet coefficients at intermediate lifting steps towards the end of one GOP (group of pictures) until intermediate coefficients from the beginning of the next GOP are available. The wavelet transform scheme does not physically break the video sequence into GOPs, but processes the sequence without intermission. In this manner, the system simulates an infinite wavelet transformation across frame boundaries and the boundary effect is significantly reduced or essentially eliminated. Moreover, the buffering is very small and the scheme can be used to implement other decomposition structures. The wavelet transform scheme provides superb video playback quality with little or no boundary effects.

摘要翻译： 视频编码系统和方法利用三维小波变换，其存储器有效并且减少跨边界的边界效应。 该变换采用基于提升的方案，并且在一个GOP（图像组）的结尾的中间提升步骤处缓冲小波系数，直到来自下一个GOP的开始的中间系数可用。 小波变换方案不会将视频序列物理地分解成GOP，而是在不间断的情况下处理序列。 以这种方式，系统模拟跨帧边界的无限小波变换，并且边界效应被显着减少或基本上消除。 此外，缓冲非常小，并且该方案可以用于实现其他分解结构。 小波变换方案提供极好的视频播放质量，很少或没有边界效应。

公开(公告)号：US07949049B2

公开(公告)日：2011-05-24

申请号：US10897273

申请日：2004-08-06

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang ,  Zixiang Xiong

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang ,  Zixiang Xiong

IPC分类号： H04N11/02 ,  H04N7/12

CPC分类号： H04N19/61 ,  H04N19/102 ,  H04N19/63

摘要： A video coding system and method utilizes a 3-D wavelet transform that is memory efficient and reduces boundary effect across frame boundaries. The transform employs a lifting-based scheme and buffers wavelet coefficients at intermediate lifting steps towards the end of one GOP (group of pictures) until intermediate coefficients from the beginning of the next GOP are available. The wavelet transform scheme does not physically break the video sequence into GOPs, but processes the sequence without intermission. In this manner, the system simulates an infinite wavelet transformation across frame boundaries and the boundary effect is significantly reduced or essentially eliminated. Moreover, the buffering is very small and the scheme can be used to implement other decomposition structures. The wavelet transform scheme provides superb video playback quality with little or no boundary effects.

摘要翻译： 视频编码系统和方法利用三维小波变换，其存储器有效并且减少跨边界的边界效应。 该变换采用基于提升的方案，并且在一个GOP（图像组）的结尾的中间提升步骤处缓冲小波系数，直到来自下一个GOP的开始的中间系数可用。 小波变换方案不会将视频序列物理地分解成GOP，而是在不间断的情况下处理序列。 以这种方式，系统模拟跨帧边界的无限小波变换，并且边界效应被显着减少或基本上消除。 此外，缓冲非常小，并且该方案可以用于实现其他分解结构。 小波变换方案提供极好的视频播放质量，很少或没有边界效应。

公开(公告)号：US07675976B2

公开(公告)日：2010-03-09

申请号：US10901524

申请日：2004-07-29

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a 3-D wavelet transform is applied in two parts. First, a temporal 1-D wavelet transform is applied to the corresponding pixels along the motion trajectories in a time direction. The temporal wavelet transform produces decomposed frames of temporal wavelet transforms, where the spatial correlation within each frame is well preserved. Second, a spatial 2-D wavelet transform is applied to all frames containing the temporal wavelet coefficients. The wavelet transforms produce coefficients within different sub-bands. The process then codes wavelet coefficients. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. During the coding, bits are allocated among sub-bands according to a technique that optimizes rate-distortion characteristics.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，三维小波变换分为两部分。 首先，沿时间方向沿着运动轨迹将时间1-D小波变换应用于相应的像素。 时间小波变换产生时间小波变换的分解帧，其中每帧内的空间相关性保持良好。 其次，将空间二维小波变换应用于包含时间小波系数的所有帧。 小波变换产生不同子带内的系数。 然后，该过程编码小波系数。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 在编码期间，根据优化速率失真特性的技术，在子带中分配比特。

公开(公告)号：US20050074065A1

公开(公告)日：2005-04-07

申请号：US10984159

申请日：2004-11-09

申请人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

发明人： Jizheng Xu ,  Shipeng Li ,  Ya-Qin Zhang

IPC分类号： H04N7/12 ,  H04N7/26

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/147 ,  H04N19/19 ,  H04N19/61 ,  H04N19/62 ,  H04N19/63 ,  H04N19/647

摘要： A video encoding system and method utilizes a three-dimensional (3-D) wavelet transform and entropy coding that utilize motion information in a way to reduce the sensitivity to motion. In one implementation, the coding process initially estimates motion trajectories of pixels in a video object from frame to frame in a video sequence to account for motion of the video object throughout the frames. After motion estimation, a wavelet transform is applied to produce coefficients within different sub-bands. The wavelet coefficients are coded independently for each sub-band to permit easy separation at a decoder, making resolution scalability and temporal scalability natural and easy. In particular, the coefficients are assigned various contexts based on the significance of neighboring samples in previous, current, and next frame, thereby taking advantage of any motion information between frames.

摘要翻译： 视频编码系统和方法利用利用运动信息的三维（3-D）小波变换和熵编码来降低对运动的敏感度。 在一个实施方案中，编码过程最初估计视频序列中的视频对象中的像素的运动轨迹，以考虑视频对象在整个帧中的运动。 运动估计后，应用小波变换产生不同子带内的系数。 对于每个子带，小波系数被独立地编码，以便在解码器处容易地分离，使得分辨率可扩展性和时间可扩展性自然而简单。 特别地，根据前一帧，当前帧和下一帧中相邻采样的重要性，将系数分配给各种上下文，从而利用帧之间的任何运动信息。