公开(公告)号：US20080292003A1

公开(公告)日：2008-11-27

申请号：US12150018

申请日：2008-04-24

Applicant: Ye-Kui Wang ,  Miska Hannuksela

Inventor： Ye-Kui Wang ,  Miska Hannuksela

IPC: H04N7/26

CPC classification number: H04N7/50 ,  H04N19/127 ,  H04N19/136 ,  H04N19/172 ,  H04N19/174 ,  H04N19/44 ,  H04N19/46 ,  H04N19/61 ,  H04N21/234327 ,  H04N21/234381 ,  H04N21/4382 ,  H04N21/4621 ,  H04N21/64707 ,  H04N21/8455 ,  H04N21/8547

Abstract: The exemplary embodiments of this invention provide in one aspect thereof an ability to signal multiple decoding times for each sample in a file format level in order to allow, for example, different decoding times for each sample (or sample subset) between decoding an entire stream and decoding a subset of the stream. An alternate decoding time box is specified to allow for the signaling of multiple decoding times for each sample. Such a box can contain a compact version of a table that allows indexing from an alternate decoding time to a sample number, where an alternate decoding time is a decoding time to be used with a sample when only a subset of an elementary stream stored in a track is to be decoded. Furthermore, each entry in the table provides the number of consecutive samples with the same time delta, and the delta between those consecutive samples. By adding the deltas a complete time-to-sample map can be constructed.

Abstract translation: 本发明的示例性实施例在其一个方面中提供以文件格式级别为每个样本发送多个解码时间的能力，以便例如在解码整个流之间为每个样本（或样本子集）提供不同的解码时间 并解码流的子集。 指定替代解码时间框以允许每个样本的多个解码时间的信令。 这样的盒子可以包含表格的紧凑版本，其允许从备选解码时间到样本号码的索引，其中替代解码时间是当仅存储在一个样本中的基本流的子集时与样本一起使用的解码时间 轨道将被解码。 此外，表中的每个条目提供具有相同时间增量的连续样本的数量，以及这些连续采样之间的增量。 通过添加三角形可以构建完整的时间到样本地图。

公开(公告)号：US20080260047A1

公开(公告)日：2008-10-23

申请号：US12103611

申请日：2008-04-15

Applicant: Miska M. Hannuksela ,  Ye-Kui Wang

Inventor： Miska M. Hannuksela ,  Ye-Kui Wang

IPC: H04N7/26

CPC classification number: H04L1/0061 ,  H04L1/1671 ,  H04N19/30 ,  H04N19/34 ,  H04N19/61 ,  H04N19/70

Abstract: A system and method provides a first integrity check code that can be calculated at an encoder and then sent to a decoder as a supplemental enhancement information message. The decoder can then calculate a second integrity check code over the actual received network abstraction layer units. This second integrity check code can be compared with the encoder-generated first integrity check code sent via the supplemental enhancement information message to indicate if in fact all of the transmitted NAL units from which the integrity check code was generated have been received without changes in their content. In addition, an error tracking algorithm is provided that can be run at either the encoder or the decoder in order to determine if the network abstraction layer units are correct in content at the decoder level. Therefore, pictures that are sent as just intra coded frames and pictures that are sent as just inter coded frames can both be checked for errors. Hence, error checking can be provided in those situations where the decoder fails to provide adequate information to the encoder as to what has actually been decoded.

Abstract translation: 系统和方法提供可以在编码器处计算的第一完整性校验码，然后作为补充增强信息消息发送到解码器。 然后，解码器可以在实际接收的网络抽象层单元上计算第二完整性校验码。 该第二完整性校验码可以与通过补充增强信息消息发送的编码器生成的第一完整性校验码进行比较，以指示是否已经接收到从其产生完整性校验码的所有发送的NAL单元，而不改变它们 内容。 另外，提供了可以在编码器或解码器处运行的误差跟踪算法，以便确定网络抽象层单元在解码器级别的内容是否正确。 因此，作为仅帧内编码帧发送的图像和仅作为帧间编码帧发送的图像可以被检查错误。 因此，在解码器无法向编码器提供关于实际解码的信息的情况下，可以提供错误检查。

公开(公告)号：US20080260034A1

公开(公告)日：2008-10-23

申请号：US11874123

申请日：2007-10-17

Applicant: Ye-Kui Wang ,  Ying Chen ,  Miska Hannuksela

Inventor： Ye-Kui Wang ,  Ying Chen ,  Miska Hannuksela

IPC: H04N7/26

CPC classification number: H04N19/573 ,  H04N19/176 ,  H04N19/31 ,  H04N19/33 ,  H04N19/44 ,  H04N19/503 ,  H04N19/52 ,  H04N19/61 ,  H04N19/70

Abstract: An improved system and method for implementing efficient decoding of scalable video bitstreams is provided. A virtual decoded picture buffer is provided for each lower layer of the scalable video bitstream. The virtual decoded picture buffer stores decoded lower layer pictures for reference. The decoded lower layer pictures used for reference are compiled to create a reference picture list for each layer. The reference picture list generated by the virtual decoded picture buffer is used during a direct prediction process instead of a target reference list to correctly decode a current macroblock.

Abstract translation: 提供了一种用于实现可分级视频比特流的有效解码的改进的系统和方法。 为可分级视频比特流的每个下层提供虚拟解码图像缓冲器。 虚拟解码图像缓冲器存储用于参考的经解码的下层图像。 用于参考的经解码的下层图片被编译以为每层创建参考图片列表。 在直接预测处理期间使用由虚拟解码图像缓冲器生成的参考图像列表，而不是目标参考列表以正确解码当前宏块。

公开(公告)号：US20080181228A1

公开(公告)日：2008-07-31

申请号：US12016155

申请日：2008-01-17

Applicant: Miska Hannuksela ,  Ye-Kui Wang

Inventor： Miska Hannuksela ,  Ye-Kui Wang

IPC: H04L12/56 ,  H04Q7/20

CPC classification number: H04N19/61 ,  H04L65/608 ,  H04N19/107 ,  H04N19/172 ,  H04N19/187 ,  H04N19/31 ,  H04N19/503 ,  H04N19/52 ,  H04N19/66 ,  H04N19/70 ,  H04N21/234327 ,  H04N21/2381 ,  H04N21/6437 ,  H04N21/8451

Abstract: A system and method of modifying error resiliency features by conveying temporal level 0 picture indices, such as tl0_pic_idx, within an SEI message instead of optionally including them in the NAL unit header is provided. In addition, a mechanism is provided for enabling repetition of any SEI messages in Real-Time Transport Protocol (RTP) packets. Enabling such repetition of any SEI messages facilitates detection of lost temporal level 0 pictures on the basis of any received packet.

Abstract translation: 提供了通过在SEI消息内传送时间等级0图像索引（诸如tl0_pic_idx）而不是可选地将它们包括在NAL单元头部来修改错误弹性特征的系统和方法。 另外，提供了一种能够重复实时传输协议（RTP）分组中的任何SEI消息的机制。 启用任何SEI消息的这种重复有助于基于任何接收到的分组检测丢失的时间级0图像。

公开(公告)号：US20080095234A1

公开(公告)日：2008-04-24

申请号：US11854470

申请日：2007-09-12

Applicant: Ye-Kui Wang ,  Miska Hannuksela ,  Ying Chen

Inventor： Ye-Kui Wang ,  Miska Hannuksela ,  Ying Chen

IPC: H04N11/02

CPC classification number: H04N7/52 ,  H04N19/11 ,  H04N19/142 ,  H04N19/157 ,  H04N19/176 ,  H04N19/187 ,  H04N19/31 ,  H04N19/46 ,  H04N19/50 ,  H04N19/513 ,  H04N19/597

Abstract: A system and method for implementing low complexity multi-view video coding. According to various embodiments, single-loop decoding is applied to multi-view video coding. For N coded views, where only M of the N views are to be displayed, only those M views are required to be fully decoded and stored to a decoded picture buffer (DPB) when needed. Pictures of other views are only partially decoded or simply parsed and do not have to be stored into the DPB. Various embodiments also provide for an encoder that encodes multi-view video bitstreams in accordance with the single-loop decoding concept, as well as a decoder that utilizes single-loop decoding to decode and output on a subset of the encoded views from a multi-view bitstream.

Abstract translation: 一种用于实现低复杂度多视图视频编码的系统和方法。 根据各种实施例，单环路解码被应用于多视点视频编码。 对于N个编码视图，其中仅显示N个视图的M个，在需要时仅需要将M个视图完全解码并存储到解码图像缓冲器（DPB）。 其他视图的图片仅部分解码或简单解析，无需存储到DPB中。 各种实施例还提供了一种编码器，其根据单环路解码概念对多视点视频比特流进行编码，以及解码器，其利用单循环解码从多路视频视频流的多重视频流中解码和输出编码视图的子集， 查看比特流。

公开(公告)号：US07206456B2

公开(公告)日：2007-04-17

申请号：US10303824

申请日：2002-11-26

Applicant: Miska Hannuksela ,  Ye-Kui Wang

Inventor： Miska Hannuksela ,  Ye-Kui Wang

IPC: G06K9/36 ,  G06K9/46

CPC classification number: H04N19/29 ,  H04N19/17 ,  H04N19/174 ,  H04N19/23

Abstract: A video coding and decoding method, wherein a picture is first divided into sub-pictures corresponding to one or more subjectively important picture regions and to a background region sub-picture, which remains after the other sub-pictures are removed from the picture. The sub-pictures are formed to conform to predetermined allowable groups of video coding macroblocks (MBs). The allowable groups of MBs can be, for example, of rectangular shape. The picture is then divided into slices so that each sub-picture is encoded independent of other sub-pictures except for the background region sub-picture, which may be coded using another sub-pictures. The slices of the background sub-picture are formed in a scan-order with skipping over MBs that belong to another sub-picture. The background sub-picture is only decoded if all the positions and sizes of all other sub-pictures can be reconstructed on decoding the picture.

Abstract translation: 一种视频编码和解码方法，其中首先将图像划分为与一个或多个主观重要的图像区域对应的子图像和在从图像中移除其它子图像之后保持的背景区域子图像。 子图像形成为符合预定的允许的视频编码宏块（MB）组。 MB的允许组可以是例如矩形。 然后将图像分成片，使得每个子图像独立于除了背景区域子图像之外的其他子图像，其可以使用另一个子图像进行编码。 背景子图像的切片以扫描顺序形成，跳过属于另一子图像的MB。 只有在对图像进行解码时可以重构所有其他子图像的所有位置和大小时，才解码背景子图像。

公开(公告)号：US20060233243A1

公开(公告)日：2006-10-19

申请号：US11402410

申请日：2006-04-12

Applicant: Justin Ridge ,  Ye-Kui Wang ,  Yiliang Bao ,  Marta Karczewicz ,  Xianglin Wang

Inventor： Justin Ridge ,  Ye-Kui Wang ,  Yiliang Bao ,  Marta Karczewicz ,  Xianglin Wang

IPC: H04N7/12 ,  H04B1/66 ,  H04N11/02 ,  H04N11/04

CPC classification number: H04N21/236 ,  H04N19/34 ,  H04N19/61 ,  H04N19/70 ,  H04N21/234327 ,  H04N21/4621 ,  H04N21/64792 ,  H04N21/8451

Abstract: A system and method for providing improved FGS identification in scalable video coding. According to the present invention, each FGS enhancement layer is assigned a unique dependency identifier and contains only FGS enhancement information. For subsequent enhancement layers, the base dependency identifier will point to either a base-quality layer or an FGS enhancement layer. Alternatively, two base dependency identifiers can be used. One identifier is used to identify the base quality layer, which does not contain FGS information, that is used for the prediction of coding mode and motion information for a subsequent enhancement layer. The other identifier is used to identify the FGS enhancement layer, which contains only FGS information, that is used for the prediction of sample and/or residual data for a subsequent enhancement layer.

Abstract translation: 一种用于在可缩放视频编码中提供改进的FGS识别的系统和方法。 根据本发明，每个FGS增强层被分配唯一的相关性标识符，并且仅包含FGS增强信息。 对于随后的增强层，基本相关性标识符将指向基本质量层或FGS增强层。 或者，可以使用两个基本相关性标识符。 一个标识符用于识别不包含用于预测后续增强层的编码模式和运动信息的FGS信息的基本质量层。 另一个标识符用于识别仅包含FGS信息的FGS增强层，其用于预测后续增强层的样本和/或残差数据。

公开(公告)号：US09807431B2

公开(公告)日：2017-10-31

申请号：US11874138

申请日：2007-10-17

Applicant: Miska Hannuksela ,  Ye-Kui Wang

Inventor： Miska Hannuksela ,  Ye-Kui Wang

IPC: H04N21/236 ,  H04N21/414 ,  H04N21/434 ,  H04N21/6377 ,  H04N21/6437 ,  H04N21/647 ,  H04N21/658 ,  H04N21/81

CPC classification number: H04N21/23614 ,  H04N21/41407 ,  H04N21/4348 ,  H04N21/6377 ,  H04N21/6437 ,  H04N21/64792 ,  H04N21/658 ,  H04N21/8106

Abstract: A file format structure for use with scalable video coding systems and methods, where a rate share operation box indicates which adaptation operation points for coded media are available in a file. The rate share operation box can include a characterization of the adaptation result for each adaptation operation point. In addition, the rate share operation box can include an identifier that indicates which algorithm was used in generating each adaptation operation point.

公开(公告)号：US09237178B2

公开(公告)日：2016-01-12

申请号：US13015237

申请日：2011-01-27

Applicant: Hongbing Li ,  Ye-Kui Wang ,  Peng Zhang ,  Yunchao Gao ,  Hong Heather Yu

Inventor： Hongbing Li ,  Ye-Kui Wang ,  Peng Zhang ,  Yunchao Gao ,  Hong Heather Yu

IPC: H04L29/06

CPC classification number: H04L65/607 ,  H04L65/60 ,  H04L65/608 ,  H04L65/80

Abstract: A system and method for providing media streaming are provided. A media description file having a range string indicator is used to specify location offsets of a plurality of media fragments within a media file. The range string may be stored directly in the media description file or the media description file may contain an indicator specifying a file containing the range string. The media description file may also include a range unit specifying the size of the offsets in the range string. In an embodiment, offsets within the individual media fragments may also be provided, either in the media description file or in a different file.

Abstract translation: 提供了一种用于提供媒体流的系统和方法。 使用具有范围字符串指示符的媒体描述文件来指定媒体文件中的多个媒体片段的位置偏移。 范围字符串可以直接存储在媒体描述文件中，或者媒体描述文件可以包含指定包含范围字符串的文件的指示符。 媒体描述文件还可以包括指定范围串中的偏移的大小的范围单位。 在一个实施例中，也可以在媒体描述文件中或不同的文件中提供各个媒体片段内的偏移。

公开(公告)号：US09049449B2

公开(公告)日：2015-06-02

申请号：US11105421

申请日：2005-04-13

Applicant: Ye-Kui Wang ,  Miska Hannuksela

Inventor： Ye-Kui Wang ,  Miska Hannuksela

IPC: H04N7/12 ,  H04N19/36 ,  H04N19/70 ,  H04N19/33 ,  H04N19/423 ,  H04N19/573 ,  H04N19/34

CPC classification number: H04N19/36 ,  H04N19/33 ,  H04N19/34 ,  H04N19/423 ,  H04N19/573 ,  H04N19/70

Abstract: A method of encoding scalable video data having multiple layers where each layer in the multiple layers is associated with at least one other layer includes identifying one or more layers using a first identifier where the first identifier indicates decoding dependency, and identifying reference pictures within the identified one or more layers using a second identifier. The coding of the second identifier for pictures in a first layer is independent of pictures in a second enhancement layer. As such, for all pictures with a certain value of DependencyID, the syntax element frame_num is coded independently of other pictures with different values of DependencyID. Within all pictures with a pre-determined value of DependencyID, a default frame_num coding method is used.

Abstract translation: 一种用于对具有多个层的可分级视频数据进行编码的方法，其中多个层中的每个层与至少一个其它层相​​关联包括使用第一标识符识别一个或多个层，其中第一标识符指示解码依赖性，以及识别所识别的参考图像 使用第二标识符的一个或多个层。 第一层中图像的第二标识符的编码与第二增强层中的图像无关。 这样，对于具有一定值DependencyID的所有图像，语法元素frame_num独立于具有不同值DependencyID的其他图像被编码。 在具有DependencyID的预定值的所有图像中，使用默认的frame_num编码方法。