公开(公告)号：US20110249746A1

公开(公告)日：2011-10-13

申请号：US12998899

申请日：2009-12-08

申请人： Jiheng Yang ,  Li Hua Zhu ,  Hui Zhang

发明人： Jiheng Yang ,  Li Hua Zhu ,  Hui Zhang

IPC分类号： H04N7/26

CPC分类号： H04N19/00 ,  H04N7/0102 ,  H04N7/0125 ,  H04N7/0152 ,  H04N7/0157 ,  H04N19/48 ,  H04N21/234363 ,  H04N21/234381 ,  H04N21/43637

摘要： Video equipment, e.g. for TV producers studios, need to display multiple channels of bit-streams simultaneously. Decoding multiple streams of high bit-rate videos is extremely computational intensive. An improved method for browsing an encoded frequency domain video sequence comprises steps of determining a spatial and/or temporal reduction level for browsing a video sequence, determining according to the determined reduction level frames, fields or parts of blocks or macroblocks to be skipped for decoding, and decoding the remaining data to a video with lower spatial and/or temporal resolution. The reduction may include adaptive partial coefficient decoding, motion vector truncation and/or simplified deblocking filtering. The reduction of spatial resolution is advantageously performed in the frequency domain, so that the inverse quantization process and the iDCT processes require less computing.

摘要翻译： 视频设备，例如 对于电视制作工作室，需要同时显示多个通道的位流。 解码多个高比特率视频流是非常计算密集的。 用于浏览编码的频域视频序列的改进方法包括确定用于浏览视频序列的空间和/或时间缩减级别的步骤，根据所确定的缩减级别帧，要跳过的块或宏块的区域或部分进行解码 并且将剩余数据解码为具有较低空间和/或时间分辨率的视频。 减少可以包括自适应部分系数解码，运动矢量截断和/或简化的去块滤波。 有利地在频域中执行空间分辨率的降低，使得逆量化处理和iDCT处理需要更少的计算。

公开(公告)号：US20100135418A1

公开(公告)日：2010-06-03

申请号：US12590978

申请日：2009-11-17

申请人： Hui Zhang ,  Li Hua Zhu ,  Charles Chuanming Wang

发明人： Hui Zhang ,  Li Hua Zhu ,  Charles Chuanming Wang

IPC分类号： H04N11/02

CPC分类号： H04N19/423 ,  H04N19/436 ,  H04N19/44

摘要： A method for utilizing a CUDA based GPU to accelerate a complex, sequential task such as video decoding, comprises decoding on a CPU headers and macroblocks of encoded video, performing inverse quantization (on CPU or GPU), transferring the picture data to GPU, where it is stored in a global buffer, and then on the GPU performing inverse waveform transforming of the inverse quantized data, performing motion compensation, buffering the reconstructed picture data in a GPU global buffer, determining if the decoded picture data are used as reference for decoding a further picture, and if so, copying the decoded picture data from the GPU global buffer to a GPU texture buffer. Advantages are that the data communication between CPU and GPU is minimized, the workload of CPU and GPU is balanced and the modules off-loaded to GPU can be efficiently realized since they are data-parallel and compute-intensive.

摘要翻译： 一种利用基于CUDA的GPU来加速诸如视频解码的复杂顺序任务的方法包括对编码视频的CPU头部和宏块进行解码，执行逆量化（在CPU或GPU上），将图像数据传送到GPU，其中 存储在全局缓冲器中，然后在GPU上执行逆量化数据的逆波形变换，执行运动补偿，在GPU全局缓冲器中缓冲重建的图像数据，确定解码的图像数据是否用作解码的参考 如果是，将解码的图像数据从GPU全局缓冲器复制到GPU纹理缓冲器。 优点是CPU和GPU之间的数据通信最小化，CPU和GPU的工作负载平衡，并且卸载到GPU的模块可以有效地实现，因为它们是数据并行和计算密集型的。

公开(公告)号：US08179961B2

公开(公告)日：2012-05-15

申请号：US12309336

申请日：2006-07-17

申请人： Zhi Bo Chen ,  Xiao Dong Gu ,  Li Hua Zhu ,  Qu Qing Chen

发明人： Zhi Bo Chen ,  Xiao Dong Gu ,  Li Hua Zhu ,  Qu Qing Chen

IPC分类号： H04N7/26 ,  H04N11/04

CPC分类号： H04N19/577 ,  H04N19/115 ,  H04N19/142 ,  H04N19/152 ,  H04N19/17 ,  H04N19/179 ,  H04N19/61 ,  H04N19/87

摘要： The frame following a scene cut is usually coded as an I picture. In CBR encoding, the encoder will try to keep the bit rate constant, which will often cause serious picture quality degradation at scene changes. In VBR encoding, more bits will be allocated to the first frame of the new scene and the bit rate will increase significantly for a short time. Therefore subsequent frames must be coded in ‘skipped’ mode, which will often cause jerk artifacts. According to the invention, in each frame belonging to a scene change period, areas are determined that have different human attention levels. In the frames (n−1, n−2, n−3) located prior to the first new scene frame, to the areas having a lower attention level less bits are assigned than in the default encoding, and in the frames (n, n+1, n+2) located at and after the scene cut the thus saved bits are additionally assigned to the areas having a higher attention level.

摘要翻译： 场景切割后的帧通常被编码为I图像。 在CBR编码中，编码器将尝试保持比特率恒定，这将导致场景变化导致严重的图像质量下降。 在VBR编码中，更多位将被分配给新场景的第一帧，并且比特率将在短时间内显着增加。 因此，后续帧必须以“跳过”模式进行编码，这通常会引起抖动伪像。 根据本发明，在属于场景变化期间的每个帧中，确定具有不同人的注意力水平的区域。 在位于第一新场景帧之前的帧（n-1，n-2，n-3）中，对于具有较低注意力级别的区域，比在默认编码中分配较少的位，并且在帧（n， n + 1，n + 2）被分配给具有较高关注度的区域。

公开(公告)号：US08009730B2

公开(公告)日：2011-08-30

申请号：US11439692

申请日：2006-05-23

申请人： Li Hua Zhu ,  Philippe Guillotel ,  Charles Wang

发明人： Li Hua Zhu ,  Philippe Guillotel ,  Charles Wang

IPC分类号： H04N7/12 ,  H04N11/02

CPC分类号： H04N19/126 ,  H04N19/147 ,  H04N19/176 ,  H04N19/196 ,  H04N19/61

摘要： Constant-bitrate rate control is very useful for real-time video transmission. However, it is difficult to realize a good CBR rate control in an MPEG4-AVC video codec. According to the invention, an adapted ρ-domain rate control processing for real-time rate control is applied, whereby ρ is the percentage of zero amplitude transform coefficients following quantization. A couple of tables are used for mapping between the quantization parameters and ρ. A detailed analysis at transform level is carried out in order to get the slope of the relationship between the bitrate and ρ. The slope of the linear model is constrained by a look-ahead procedure with respect to the neighbor frames or blocks.

摘要翻译： 恒定位速率控制对于实时视频传输非常有用。 然而，难以在MPEG4-AVC视频编解码器中实现良好的CBR速率控制。 根据本发明，应用了用于实时速率控制的适应的域速率控制处理，其中， 是量化后的零幅度变换系数的百分比。 使用几个表来量化参数和＆rgr之间的映射。 进行变换级的详细分析，以获得比特率和rgr之间的关系的斜率。 线性模型的斜率受到相邻帧或块的预先处理的约束。

公开(公告)号：US09277210B2

公开(公告)日：2016-03-01

申请号：US12998899

申请日：2009-12-08

申请人： Jiheng Yang ,  Li Hua Zhu ,  Hui Zhang

发明人： Jiheng Yang ,  Li Hua Zhu ,  Hui Zhang

IPC分类号： H04N7/12 ,  H04N19/00 ,  H04N7/01 ,  H04N21/2343 ,  H04N21/4363 ,  H04N19/48 ,  H04N7/015

CPC分类号： H04N19/00 ,  H04N7/0102 ,  H04N7/0125 ,  H04N7/0152 ,  H04N7/0157 ,  H04N19/48 ,  H04N21/234363 ,  H04N21/234381 ,  H04N21/43637

摘要： Video equipment, e.g. for TV producers studios, need to display multiple channels of bit-streams simultaneously. Decoding multiple streams of high bit-rate videos is extremely computational intensive. An improved method for browsing an encoded frequency domain video sequence comprises steps of determining a spatial and/or temporal reduction level for browsing a video sequence, determining according to the determined reduction level frames, fields or parts of blocks or macroblocks to be skipped for decoding, and decoding the remaining data to a video with lower spatial and/or temporal resolution. The reduction may include adaptive partial coefficient decoding, motion vector truncation and/or simplified deblocking filtering. The reduction of spatial resolution is advantageously performed in the frequency domain, so that the inverse quantization process and the iDCT processes require less computing.

摘要翻译： 视频设备，例如 对于电视制作工作室，需要同时显示多个通道的位流。 解码多个高比特率视频流是非常计算密集型的。 用于浏览编码的频域视频序列的改进方法包括确定用于浏览视频序列的空间和/或时间缩减级别的步骤，根据所确定的缩减级别帧，要跳过的块或宏块的区域或部分进行解码 并且将剩余数据解码为具有较低空间和/或时间分辨率的视频。 减少可以包括自适应部分系数解码，运动矢量截断和/或简化的去块滤波。 有利地在频域中执行空间分辨率的降低，使得逆量化处理和iDCT处理需要更少的计算。

公开(公告)号：US08457434B2

公开(公告)日：2013-06-04

申请号：US12229249

申请日：2008-08-21

申请人： Li Hua Zhu ,  Guang Fei Zhu ,  Jiheng Yang

发明人： Li Hua Zhu ,  Guang Fei Zhu ,  Jiheng Yang

IPC分类号： G06K9/40 ,  G09G5/00

CPC分类号： G06T5/20 ,  G06T5/002 ,  G06T5/003 ,  G06T2207/20028 ,  G06T2207/20192

摘要： The invention is related to spatial diffusion in images. Spatial diffusion helps blurring small discontinuities. Edges become sharper by spatial diffusion as well.A method for generating a spatial diffused image from an input image is described wherein the method comprises applying on the input image an inverted Gaussian spatial bilateral filter with a spatial weight which takes the form of an inverted Gaussian.The inverted-Gaussian-spatial bilateral filter, which uses an inverted-Gaussian function as the kernel of spatial filter, can remove small spots in large smooth areas efficiently.

公开(公告)号：US20100208800A1

公开(公告)日：2010-08-19

申请号：US12734123

申请日：2008-10-01

申请人： Hui Zhang ,  Li Hua Zhu ,  Jiheng Yang

发明人： Hui Zhang ,  Li Hua Zhu ,  Jiheng Yang

IPC分类号： H04N7/26

CPC分类号： H04N19/86 ,  H04N19/117 ,  H04N19/14 ,  H04N19/176 ,  H04N19/44 ,  H04N19/61 ,  H04N19/80

摘要： The invention is related to a method for decoding an image frame of an image frame sequence and to a corresponding decoder. The method comprises the steps of reconstructing a representation of the image frame, classifying at least one block boundary as to be either high-freq or low-freq and filtering pixels of the at least one block boundary in dependency on the classification and outputting the filtered representation. Film grain noise and/or random texture are more likely to produce high-freq boundaries. Therefore, filtering boundary pixels in dependency on frequency classification helps preserving film grain noise and random texture which are of relevance for video quality at high bit rates.

摘要翻译： 本发明涉及一种用于对图像帧序列的图像帧进行解码的方法和相应的解码器。 该方法包括以下步骤：重建图像帧的表示，将至少一个块边界分类为高频或低频，并根据分类过滤至少一个块边界的像素，并输出滤波后的 表示。 胶片颗粒噪声和/或随机纹理更可能产生高频边界。 因此，根据频率分类过滤边界像素有助于保持与高比特率下的视频质量相关的胶片颗粒噪声和随机纹理。

公开(公告)号：US20090175330A1

公开(公告)日：2009-07-09

申请号：US12309336

申请日：2006-07-17

申请人： Zhi Bo Chen ,  Xiao Dong Gu ,  Li Hua Zhu ,  Qu Qing Chen

发明人： Zhi Bo Chen ,  Xiao Dong Gu ,  Li Hua Zhu ,  Qu Qing Chen

IPC分类号： H04N7/26

CPC分类号： H04N19/577 ,  H04N19/115 ,  H04N19/142 ,  H04N19/152 ,  H04N19/17 ,  H04N19/179 ,  H04N19/61 ,  H04N19/87

摘要： The frame following a scene cut is usually coded as an I picture. In CBR encoding, the encoder will try to keep the bit rate constant, which will often cause serious picture quality degradation at scene changes. In VBR encoding, more bits will be allocated to the first frame of the new scene and the bit rate will increase significantly for a short time. Therefore subsequent frames must be coded in ‘skipped’ mode, which will often cause jerk artifacts. According to the invention, in each frame belonging to a scene change period, areas are determined that have different human attention levels. In the frames (n−1, n−2, n−3) located prior to the first new scene frame, to the areas having a lower attention level less bits are assigned than in the default encoding, and in the frames (n, n+1, n+2) located at and after the scene cut the thus saved bits are additionally assigned to the areas having a higher attention level.

摘要翻译： 场景切割后的帧通常被编码为I图像。 在CBR编码中，编码器将尝试保持比特率恒定，这将导致场景变化导致严重的图像质量下降。 在VBR编码中，更多位将被分配给新场景的第一帧，并且比特率将在短时间内显着增加。 因此，后续帧必须以“跳过”模式进行编码，这通常会引起抖动伪像。 根据本发明，在属于场景变化期间的每个帧中，确定具有不同人的注意力水平的区域。 在位于第一新场景帧之前的帧（n-1，n-2，n-3）中，对于具有较低注意力级别的区域，比在默认编码中分配较少的位，并且在帧（n， n + 1，n + 2）被分配给具有较高关注度的区域。

公开(公告)号：US20090067740A1

公开(公告)日：2009-03-12

申请号：US12229249

申请日：2008-08-21

申请人： Li Hua Zhu ,  Guang Fei Zhu ,  Jiheng Yang

发明人： Li Hua Zhu ,  Guang Fei Zhu ,  Jiheng Yang

IPC分类号： G06K9/40

CPC分类号： G06T5/20 ,  G06T5/002 ,  G06T5/003 ,  G06T2207/20028 ,  G06T2207/20192

摘要： The invention is related to spatial diffusion in images. Spatial diffusion helps blurring small discontinuities. Edges become sharper by spatial diffusion as well.A method for generating a spatial diffused image from an input image is described wherein the method comprises applying on the input image an inverted Gaussian spatial bilateral filter with a spatial weight which takes the form of an inverted Gaussian.The inverted-Gaussian-spatial bilateral filter, which uses an inverted-Gaussian function as the kernel of spatial filter, can remove small spots in large smooth areas efficiently.

摘要翻译： 本发明涉及图像中的空间扩散。 空间扩散有助于模糊小的不连续性。 边缘也因空间扩散而变得更加尖锐。 描述了一种用于从输入图像生成空间漫射图像的方法，其中所述方法包括在输入图像上应用具有反高斯形式的空间权重的反高斯空间双边滤波器。 使用反高斯函数作为空间滤波器的核的反高斯空间双边滤波器可以有效地去除大平滑区域中的小斑点。

公开(公告)号：US20130091154A1

公开(公告)日：2013-04-11

申请号：US13703936

申请日：2011-06-13

申请人： Zhenyu Lu ,  Li Hua Zhu

发明人： Zhenyu Lu ,  Li Hua Zhu

IPC分类号： G06F17/30

CPC分类号： G06F16/116 ,  H04N21/234327 ,  H04N21/235 ,  H04N21/435 ,  H04N21/64792 ,  H04N21/84 ,  H04N21/8451 ,  H04N21/85406

摘要： A method and a device for encapsulating a media entity containing more than one layer into multiple component files, each for one layer, are described along with the corresponding method and device for component file reading. Extensions to the Extractor data structure of SVC/MVC file formats are proposed. The extractor extensions of the invention enable NAL units referencing across different component files. The present invention enables adaptive HTTP streaming of media entities.

摘要翻译： 将包含多于一个层的媒体实体的方法和装置与用于组件文件读取的相应方法和设备一起描述，每个组件文件分别用于一个层。 提出了SVC / MVC文件格式的Extractor数据结构扩展。 本发明的提取器扩展使得能够跨越不同组件文件参考的NAL单元。 本发明实现媒体实体的自适应HTTP流传输。