公开(公告)号：US09918068B2

公开(公告)日：2018-03-13

申请号：US14115099

申请日：2012-06-15

申请人： Yu-Lin Chang ,  Shih-Ta Hsiang ,  Chi-Ling Wu ,  Chih-Ming Fu ,  Chia-Ping Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Yu-Lin Chang ,  Shih-Ta Hsiang ,  Chi-Ling Wu ,  Chih-Ming Fu ,  Chia-Ping Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N13/00 ,  H04N19/597 ,  H04N19/119 ,  G06T9/00 ,  H04N19/503

CPC分类号： H04N13/161 ,  G06T9/00 ,  H04N19/119 ,  H04N19/503 ,  H04N19/597

摘要： A method and apparatus for texture image compression in a 3D video coding system are disclosed. Embodiments according to the present invention derive depth information related to a depth map associated with a texture image and then process the texture image based on the depth information derived. The invention can be applied to the encoder side as well as the decoder side. The encoding order or decoding order for the depth maps and the texture images can be based on block-wise interleaving or picture-wise interleaving. One aspect of the present invent is related to partitioning of the texture image based on depth information of the depth map. Another aspect of the present invention is related to motion vector or motion vector predictor processing based on the depth information.

公开(公告)号：US20100091841A1

公开(公告)日：2010-04-15

申请号：US12575156

申请日：2009-10-07

申请人： Faisal Ishtiaq ,  Shih-Ta Hsiang ,  Aggelos K. Katsaggelos ,  Ehsan Maani ,  Serhan Uslubas

发明人： Faisal Ishtiaq ,  Shih-Ta Hsiang ,  Aggelos K. Katsaggelos ,  Ehsan Maani ,  Serhan Uslubas

IPC分类号： H04N7/26 ,  H04N7/64 ,  H04N7/24

CPC分类号： H04N19/36 ,  H04N19/132 ,  H04N19/147 ,  H04N19/187 ,  H04N19/19 ,  H04N19/31

摘要： A device for use with a frame generating portion that is arranged to receive picture data corresponding to a plurality of pictures and to generate encoded video data for transmission across a transmission channel having an available bandwidth. The frame generating portion can generate a frame for each of the plurality of pictures to create a plurality of frames. The encoded video data is based on the received picture data. The device includes a distortion estimating portion and inclusion determining portion and an extracting portion. The distortion estimating portion can estimate a distortion. The inclusion determining portion can establish an inclusion boundary based on the estimated distortion. The extracting portion can extract a frame from the plurality of frames based on the inclusion boundary.

摘要翻译： 一种与帧生成部分一起使用的装置，被配置为接收与多个图像相对应的图像数据，并且生成用于通过具有可用带宽的传输信道进行传输的编码视频数据。 帧生成部分可以为多个图像中的每一个生成帧，以创建多个帧。 编码的视频数据是基于所接收的图像数据。 该装置包括失真估计部分和包含确定部分和提取部分。 失真估计部分可以估计失真。 包含确定部分可以基于估计的失真建立包围边界。 提取部分可以基于包含边界从多个帧中提取帧。

公开(公告)号：US08467448B2

公开(公告)日：2013-06-18

申请号：US11559965

申请日：2006-11-15

申请人： Shih-Ta Hsiang ,  Faisal Ishtiaq

发明人： Shih-Ta Hsiang ,  Faisal Ishtiaq

IPC分类号： H04N7/12

CPC分类号： H04N19/19 ,  H04N19/109 ,  H04N19/147 ,  H04N19/176 ,  H04N19/50 ,  H04N19/61

摘要： A fast video encoder (100) and method (500) for selecting (809) Inter macro-block mode or intra macro-block mode is provided. The method can include estimating (502) a rate-distortion cost (801) of a plurality of predictors (203) for coding a video (201), selecting (504) a predictive coding mode for the video based on a minimization of the rate-distortion cost, and coding (505) the image using a predictive mode associated with the minimum rate-distortion cost. The rate-distortion cost can be estimated across Intra macro-block modes and Inter macro-block modes for reducing a computational complexity. Rate-Distortion costs can be terminated early (524) based on statistical information (522) across a plurality of predictors for increasing an encoding speed. A fast estimation of the rate-distortion cost associated with the Intra macro-block mode for making inter/intra macro-block mode decision in a video coding system by exploiting the coding statistics across prediction modes is presented.

摘要翻译： 提供了用于选择（809）宏块间宏块或宏块内模式的快速视频编码器（100）和方法（500）。 该方法可以包括估计（502）用于编码视频（201）的多个预测器（203）的速率失真成本（801），基于速率的最小化来选择（504）视频的预测编码模式 使用与最小速率 - 失真成本相关联的预测模式对图像进行编码（505）。 可以通过Intra宏块模式和Inter宏块模式来估计速率失真成本，以降低计算复杂度。 速率失真成本可以基于多个预测器中的统计信息（522）提前终止（524），以增加编码速度。 提出了通过利用跨越预测模式的编码统计量，在用于在视频编码系统中进行帧间/帧内宏块模式决定的内部宏块模式的速率失真成本的快速估计。

公开(公告)号：US08126054B2

公开(公告)日：2012-02-28

申请号：US11971354

申请日：2008-01-09

申请人： Shih-Ta Hsiang

发明人： Shih-Ta Hsiang

IPC分类号： H04N11/02

CPC分类号： H04N19/59 ,  H04N19/33 ,  H04N19/61 ,  H04N19/63 ,  H04N19/635

摘要： An apparatus and method is provided for highly scalable intraframe video coding. The conventional macroblock DCT tools are integrated with the subband filter banks for the improved efficiency of scalable compression. The enhancement layers are represented in a subband domain and coded by an inter-layer frame texture coder utilizing inter-layer prediction signal formed by the decoded previous layer. Each quality enhancement layer is additionally scalable in resolution.

摘要翻译： 提供了用于高度可缩放的帧内视频编码的装置和方法。 常规的宏块DCT工具与子带滤波器组集成以提高可伸缩压缩的效率。 增强层在子带域中表示，并由利用由解码的先前层形成的层间预测信号的层间帧纹理编码器进行编码。 每个质量增强层在分辨率方面都是可扩展的。

公开(公告)号：US20110002391A1

公开(公告)日：2011-01-06

申请号：US12795232

申请日：2010-06-07

申请人： Serhan Uslubas ,  Aggelos K. Katsaggelos ,  Faisal Ishtiaq ,  Shih-Ta Hsiang ,  Ehsan Maani

发明人： Serhan Uslubas ,  Aggelos K. Katsaggelos ,  Faisal Ishtiaq ,  Shih-Ta Hsiang ,  Ehsan Maani

IPC分类号： H04N7/26

CPC分类号： H04N19/59 ,  H04N19/132 ,  H04N19/147 ,  H04N19/176 ,  H04N19/182 ,  H04N19/19 ,  H04N19/33 ,  H04N19/46 ,  H04N19/61

摘要： Disclosed is an image encoder that divides a digital image into a set of “macroblocks.” If appropriate, a macroblock is “downsampled” to a lower resolution. The lower-resolution macroblock is then encoded by applying spatial (and possibly temporal) prediction. The “residual” of the macroblock is calculated as the difference between the predicted and actual contents of the macroblock. The low-resolution residual is then either transmitted to an image decoder or stored for later use. In some embodiments, the encoder calculates the rate-distortion costs of encoding the original-resolution macroblock and the lower-resolution macroblock and then only encodes the lower-resolution macroblock if its cost is lower. When a decoder receives a lower-resolution residual, it recovers the lower-resolution macroblock using standard prediction techniques. Then, the macroblock is “upsampled” to its original resolution by interpolating the values left out by the encoder. The macroblocks are then joined to form the original digital image.

摘要翻译： 公开了将数字图像分割为“宏块”的图像编码器。如果合适，则将宏块“下采样”为较低的分辨率。 然后通过应用空间（和可能的时间）预测来对较低分辨率的宏块进行编码。 宏块的“残差”被计算为宏块的预测和实际内容之间的差。 然后将低分辨率残差传送到图像解码器或存储以供以后使用。 在一些实施例中，编码器计算对原始分辨率宏块和较低分辨率宏块进行编码的速率 - 失真成本，并且如果其成本较低，则仅对低分辨率宏块进行编码。 当解码器接收到较低分辨率的残差时，它使用标准预测技术来恢复较低分辨率的宏块。 然后，通过内插编码器遗留的值，将宏块“上采样”为其原始分辨率。 然后连接宏块以形成原始数字图像。

公开(公告)号：US20100086048A1

公开(公告)日：2010-04-08

申请号：US12245355

申请日：2008-10-03

申请人： Faisal Ishtiaq ,  Shih-Ta Hsiang ,  Zhu Li ,  Tony May

发明人： Faisal Ishtiaq ,  Shih-Ta Hsiang ,  Zhu Li ,  Tony May

IPC分类号： H04N7/12

CPC分类号： H04N19/573 ,  H04N19/105 ,  H04N19/117 ,  H04N19/14 ,  H04N19/176 ,  H04N19/61 ,  H04N19/82

摘要： A system for processing video imaging information, corresponding electronic device, and method of processing video imaging information, are disclosed. In at least one embodiment, the electronic device includes a coder capable of compressing the imaging information for transmission via a communications channel, the video imaging information pertaining to a plurality of video source frames including a current source frame. The coder includes means for performing a super-resolution operation in relation to previous frame information representative of at least one of the video source frames occurring prior to the current source frame, the super-resolution operation being performed prior to at least some of the video imaging information corresponding to the current source frame being coded or decoded.

摘要翻译： 公开了一种用于处理视频成像信息的系统，相应的电子设备以及处理视频成像信息的方法。 在至少一个实施例中，电子设备包括能够压缩用于经由通信信道传输的成像信息的编码器，涉及包括当前源帧的多个视频源帧的视频成像信息。 编码器包括用于相对于表示在当前源帧之前出现的视频源帧中的至少一个的先前帧信息执行超分辨率操作的装置，超分辨率操作在至少一些视频之前执行 对应于当前源帧的成像信息进行编码或解码。

公开(公告)号：US20090268805A1

公开(公告)日：2009-10-29

申请号：US12108680

申请日：2008-04-24

申请人： Tamer Shanableh ,  Shih-Ta Hsiang ,  Faisal Ishtiaq

发明人： Tamer Shanableh ,  Shih-Ta Hsiang ,  Faisal Ishtiaq

IPC分类号： H04N7/26

CPC分类号： H04N19/39 ,  H04N19/172 ,  H04N19/187 ,  H04N19/63

摘要： A method and apparatus for encoding and decoding video performs transformation of at least a portion of a high-resolution video frame into a low resolution image and a plurality of enhancement data sets, encodes the low resolution image as a primary coded picture in a bitstream format and encodes each of the plurality of enhancement data sets as a different redundant coded picture in the bitstream format. For decoding, a decoded low resolution image and a plurality of decoded enhancement data sets are generated and an inverse transform is performed to construct a decoded high-resolution mage. The primary coded picture and a redundant coded picture may be formatted according to the ITU-T H.264 Advanced Coding specification. The transform may be a polyphase or a sub-band transform.

摘要翻译： 用于编码和解码视频的方法和装置执行将高分辨率视频帧的至少一部分变换为低分辨率图像和多个增强数据集，将低分辨率图像编码为比特流格式的主编码图像 并且将多个增强数据集中的每一个编码为比特流格式的不同的冗余编码图像。 为了解码，生成解码的低分辨率图像和多个解码的增强数据集，并且执行逆变换以构造解码的高分辨率法师。 主编码图像和冗余编码图像可以根据ITU-T H.264高级编码规范进行格式化。 该变换可以是多相或子带变换。

公开(公告)号：US20130195180A1

公开(公告)日：2013-08-01

申请号：US13363852

申请日：2012-02-01

申请人： Shih-Ta Hsiang

发明人： Shih-Ta Hsiang

IPC分类号： H04N7/50

CPC分类号： H04N19/625 ,  H04N19/61 ,  H04N19/63

摘要： An image (a still image or a frame of a video) is divided into macroblocks. The content of a macroblock is predicted based on the content of other macroblocks that are spatially or temporally close to the instant macroblock. The prediction is compared against the actual macroblock content to yield a residual value. The residual is then transformed by a discrete cosine (“DCT”) transformation. The resulting DCT coefficients are grouped into subbands. The subbands are encoded using embedded zero block bitplane coding (“EZBC”), and the EZBC output is sent to a decoder (usually on a device remote from the encoder). The EZBC output is also decoded by a subband-dequantizer process whose output coefficients are fed into an inverse DCT to reconstruct the residual signal. The reconstructed residual is used to refine the coding process.

摘要翻译： 图像（静止图像或视频的帧）被划分为宏块。 基于空间上或时间上接近于该宏块的其他宏块的内容来预测宏块的内容。 将预测与实际宏块内容进行比较以产生残差值。 然后通过离散余弦变换（“DCT”）变换残差。 所得到的DCT系数被分组成子带。 使用嵌入式零块位平面编码（“EZBC”）对子带进行编码，并将EZBC输出发送到解码器（通常在远离编码器的设备上）。 EZBC输出也由子带去量化器处理解码，其输出系数被馈送到逆DCT以重建残余信号。 重建的残差用于细化编码过程。

公开(公告)号：US08249142B2

公开(公告)日：2012-08-21

申请号：US12108680

申请日：2008-04-24

申请人： Tamer Shanableh ,  Shih-Ta Hsiang ,  Faisal Ishtiaq

发明人： Tamer Shanableh ,  Shih-Ta Hsiang ,  Faisal Ishtiaq

IPC分类号： H04N7/12

CPC分类号： H04N19/39 ,  H04N19/172 ,  H04N19/187 ,  H04N19/63

摘要： A method and apparatus for encoding and decoding video performs transformation of at least a portion of a high-resolution video frame into a low resolution image and a plurality of enhancement data sets, encodes the low resolution image as a primary coded picture in a bitstream format and encodes each of the plurality of enhancement data sets as a different redundant coded picture in the bitstream format. For decoding, a decoded low resolution image and a plurality of decoded enhancement data sets are generated and an inverse transform is performed to construct a decoded high-resolution image. The primary coded picture and a redundant coded picture may be formatted according to the ITU-T H.264 Advanced Coding specification. The transform may be a polyphase or a sub-band transform.

摘要翻译： 用于编码和解码视频的方法和装置执行将高分辨率视频帧的至少一部分变换为低分辨率图像和多个增强数据集，将低分辨率图像编码为比特流格式的主编码图像 并且将多个增强数据集中的每一个编码为比特流格式的不同的冗余编码图像。 为了解码，生成解码的低分辨率图像和多个解码的增强数据组，并且执行逆变换以构造解码的高分辨率图像。 主编码图像和冗余编码图像可以根据ITU-T H.264高级编码规范进行格式化。 该变换可以是多相或子带变换。

公开(公告)号：US20090285499A1

公开(公告)日：2009-11-19

申请号：US12121316

申请日：2008-05-15

申请人： Anthony R. May ,  Shih-Ta Hsiang ,  Faisal Ishtiaq ,  Zhu Li

发明人： Anthony R. May ,  Shih-Ta Hsiang ,  Faisal Ishtiaq ,  Zhu Li

IPC分类号： G06K9/46

CPC分类号： H04N19/20 ,  H04N19/136 ,  H04N19/17 ,  H04N19/174 ,  H04N19/593

摘要： A method of coding video content. The method can include, identifying a first plurality of image blocks within a picture based on at least a first image characteristic that is common to each of the first plurality of image blocks. A first image block group can be dynamically defined. At least one of the image blocks can be selected as a predictor block to predict other image blocks within the first image block group. In another arrangement, at least a first image block and a second image block can be identified within a picture. The second image block can be predicted from the first image block. A displacement vector can be defined to associate the second image block with the first image block. A value representing the displacement vector can be included within a header of the second image block.

摘要翻译： 一种编码视频内容的方法。 该方法可以包括：至少基于第一多个图像块中的每一个共同的第一图像特征来识别图片内的第一多个图像块。 可以动态定义第一个图像块组。 可以选择至少一个图像块作为预测块来预测第一图像块组内的其它图像块。 在另一种布置中，可以在图片内识别至少第一图像块和第二图像块。 可以从第一图像块预测第二图像块。 可以定义位移矢量以将第二图像块与第一图像块相关联。 表示位移矢量的值可以包括在第二图像块的标题内。