公开(公告)号：US20130083841A1

公开(公告)日：2013-04-04

申请号：US13333424

申请日：2011-12-21

Applicant: Ba-Zhong Shen ,  Wade K. Wan ,  Brian Heng ,  Zhijie Yang

Inventor： Ba-Zhong Shen ,  Wade K. Wan ,  Brian Heng ,  Zhijie Yang

IPC: H04N7/12

CPC classification number: H04N19/164 ,  H04N19/103 ,  H04N19/30 ,  H04N19/40 ,  H04N19/86 ,  H04N19/895

Abstract: Video coding infrastructure using adaptive prediction complexity reduction. One or more subsets associated with one or more frames or pictures of the video signal may be adaptively selected and used for motion vector calculation (e.g., such as in accordance with inter-prediction). For example, a picture or frame of the video signal may be partitioned into a number of respective regions. Any one or more, but typically fewer than all, of the respective regions may be appropriately selected, and stored, based on any one or more considerations for use in motion vector calculation (e.g., inter-prediction). A sub-sampled or down-sampled picture or frame [or alternatively, a sub-sampled or down-sampled version of one or more respective regions of a picture or frame] (e.g., the sub-sampling or down-sampling ratio which may be adaptively determined based on any one or more considerations) may be stored for use in motion vector calculation (e.g., inter-prediction).

Abstract translation: 视频编码基础设施采用自适应预测复杂度降低。 可以自适应地选择与视频信号的一个或多个帧或图像相关联的一个或多个子集，并将其用于运动矢量计算（例如，根据帧间预测）。 例如，视频信号的图像或帧可以被分割成多个相应的区域。 可以基于用于运动矢量计算（例如，帧间预测）的任何一个或多个考虑来适当地选择和存储各个区域中的任何一个或多个但通常少于全部的区域。 子采样或下采样图像或帧[或者替代地，图像或帧的一个或多个相应区域的子采样或下采样版本]（例如，子采样或下采样比，其可以 可以基于任何一个或多个考虑自适应地确定）可以被存储以用于运动矢量计算（例如，帧间预测）。

公开(公告)号：US20130083837A1

公开(公告)日：2013-04-04

申请号：US13333135

申请日：2011-12-21

Applicant: Brian Heng ,  Wade K. Wan ,  Zhijie Yang

Inventor： Brian Heng ,  Wade K. Wan ,  Zhijie Yang

IPC: H04N7/26

CPC classification number: H04N19/164 ,  H04N19/103 ,  H04N19/30 ,  H04N19/40 ,  H04N19/86 ,  H04N19/895

Abstract: Multi-mode error concealment, recovery and resilience coding. Adaptation of a number of coding units (CUs) employed in accordance with video coding may be made as a function of error. As a number of errors increases, the respective number of CUs may correspondingly increase (e.g., which may be made in accompaniment with a reduction of CU size). As a number of errors decreases, the respective number of CUs may correspondingly decrease (e.g., which may be made in accompaniment with an increase of CU size). Such errors may be associated with a type of source providing a video signal, a type of error resilience coding employed, communication link and/or channel conditions, a remote error characteristic (e.g., such as associated with a source device and/or destination device), a local error characteristic (e.g., such as associated with operations and/or processing within a given device), and/or any other type of consideration.

公开(公告)号：US20090097559A1

公开(公告)日：2009-04-16

申请号：US11871385

申请日：2007-10-12

Applicant: Zhijie Yang ,  Xuemin Chen

Inventor： Zhijie Yang ,  Xuemin Chen

IPC: H04N7/32

CPC classification number: H04N19/00715 ,  H04N19/44 ,  H04N19/51 ,  H04N19/577

Abstract: Methods and systems for processing B pictures with missing or invalid forward reference pictures are disclosed. Aspects of one method may include decoding of a contiguous sequence of B pictures that immediately follow a first I picture after a sequence header. The decoding of the B pictures may handle video edit codes in the AVS1-P2 format and/or random access points. Some embodiments of the invention may discard B pictures that refer to invalid or missing forward reference pictures, while other embodiments of the invention may interpolate B pictures. For an invalid forward reference picture, the interpolation algorithm for generating pictures may use the invalid forward reference picture and the backward reference picture. For a missing decoded forward reference picture, as in a random access, the interpolation algorithm for generating pictures may use the backward reference picture.

Abstract translation: 公开了用于处理具有丢失或无效正向参考图片的B图像的方法和系统。 一种方法的方面可以包括在序列头之后紧随第一I图像的B图像的连续序列的解码。 B图像的解码可以处理AVS1-P2格式和/或随机接入点中的视频编辑码。 本发明的一些实施例可以丢弃涉及无效或缺失的前向参考图片的B图像，而本发明的其他实施例可以内插B图像。 对于无效的正向参考图像，用于生成图像的内插算法可以使用无效的前向参考图像和后向参考图像。 对于丢失的解码前向参考图像，如在随机存取中，用于生成图像的内插算法可以使用反向参考图像。

公开(公告)号：US20070121620A1

公开(公告)日：2007-05-31

申请号：US11321775

申请日：2005-12-29

Applicant: Zhijie Yang ,  Xuemin Chen

Inventor： Zhijie Yang ,  Xuemin Chen

IPC: H04L12/56 ,  H04J3/06

CPC classification number: H04N21/4305 ,  H04N21/2368 ,  H04N21/4307 ,  H04N21/4341

Abstract: Aspects of a method and system for processing audio and video transport may comprise synchronizing streams with associated program content based on 24-bit presentation time stamps (PTSs) and 32-bit system clock samples (SCSs) field without using decoding time stamps (DTSs). A PTS field may be provided as part of a packetized elementary stream (PES) packet syntax. An SCS field may be provided as part of a transport stream (TS) syntax. A system clock (STC) may be determined from received SCS values. Video and/or audio data may be decoded as soon as they arrive and when there is at least one display and/or presentation frame buffer available. The video and/or audio data may be presented for display and/or play based on a comparison of the PTS and STC values. When a frame does not have an associated PTS, a PTS extrapolation operation may generate an extrapolated PTS value from previously received PTSs.

Abstract translation: 用于处理音频和视频传输的方法和系统的方面可以包括基于24位呈现时间戳（PTS）和32位系统时钟采样（SCS）字段来同步流与相关节目内容，而不使用解码时间戳（DTS） 。 可以将PTS字段提供为分组化基本流（PES）分组语法的一部分。 可以提供SCS字段作为传输流（TS）语法的一部分。 系统时钟（STC）可以从接收的SCS值确定。 视频和/或音频数据可以在它们到达时以及当存在至少一个显示和/或呈现帧缓冲器可用时被解码。 可以基于PTS和STC值的比较来呈现视频和/或音频数据以用于显示和/或播放。 当帧没有相关联的PTS时，PTS外插操作可以从先前接收的PTS产生外推的PTS值。

公开(公告)号：US09338468B2

公开(公告)日：2016-05-10

申请号：US13339674

申请日：2011-12-29

Applicant: Michael (Zhijie) Yang ,  Sherman (Xuemin) Chen ,  Brian Heng

Inventor： Michael (Zhijie) Yang ,  Sherman (Xuemin) Chen ,  Brian Heng

IPC: H04N7/26 ,  H04N19/436 ,  H04N19/44

CPC classification number: H04N19/436 ,  H04N19/44

Abstract: Various methods and systems are provided for latency aware priority based decoding. In one embodiment, among others, a method includes providing coded frames of a first input stream to a multiple channel (multi-channel) decoder for decoding. A second input stream is obtained and a latency priority associated with the second input stream is determined. Coded frames from the first and second input streams are provided to the multi-channel decoder for decoding in an order based upon the latency priorities associated with the first and second input streams. In another embodiment, a multi-channel decoding system includes a multi-channel decoder configured to decode coded frames and a decoder input scheduler configured to provide coded frames from a plurality of input streams to the multi-channel decoder for decoding. The coded frames are provided to the multi-channel decoder in an order based at least in part upon latency priorities associated with the input streams.

Abstract translation: 提供用于基于等待时间优先级的解码的各种方法和系统。 在一个实施例中，一种方法包括将第一输入流的编码帧提供给多通道（多通道）解码器进行解码。 获得第二输入流并且确定与第二输入流相关联的等待时间优先级。 基于与第一和第二输入流相关联的等待时间优先级，将来自第一和第二输入流的编码帧提供给多声道解码器以进行解码。 在另一个实施例中，多通道解码系统包括被配置为对编码帧进行解码的多通道解码器，以及解码器输入调度器，被配置为将多个输入流中的编码帧提供给多通道解码器进行解码。 编码帧至少部分地基于与输入流相关联的等待时间优先级以顺序提供给多声道解码器。

公开(公告)号：US08665954B2

公开(公告)日：2014-03-04

申请号：US13484365

申请日：2012-05-31

Applicant: Zhijie Yang ,  Xuemin Chen

Inventor： Zhijie Yang ,  Xuemin Chen

IPC: H04N11/02

CPC classification number: H04N19/00715 ,  H04N19/44 ,  H04N19/51 ,  H04N19/577

Abstract: Methods and systems for processing B pictures with missing or invalid forward reference pictures are disclosed. Aspects of one method may include decoding of a contiguous sequence of B pictures that immediately follow a first I picture after a sequence header. The decoding of the B pictures may handle video edit codes in the AVS1-P2 format and/or random access points. Some embodiments of the invention may discard B pictures that refer to invalid or missing forward reference pictures, while other embodiments of the invention may interpolate B pictures. For an invalid forward reference picture, the interpolation algorithm for generating pictures may use the invalid forward reference picture and the backward reference picture. For a missing decoded forward reference picture, as in a random access, the interpolation algorithm for generating pictures may use the backward reference picture.

公开(公告)号：US20130083840A1

公开(公告)日：2013-04-04

申请号：US13333332

申请日：2011-12-21

Applicant: Brian Heng ,  Wade K. Wan ,  Zhijie Yang

Inventor： Brian Heng ,  Wade K. Wan ,  Zhijie Yang

IPC: H04N7/26

CPC classification number: H04N19/164 ,  H04N19/103 ,  H04N19/30 ,  H04N19/40 ,  H04N19/86 ,  H04N19/895

Abstract: Advance encode processing based on raw video data. Adaptive processing of a video signal may be made by making one or more decisions and/or directing one or more encoding steps based upon characteristic(s) associated with the video signal in raw form (e.g., before the video signal undergoing any processing in accordance with generating an output video bitstream). Characteristic(s) associated with the video signal (raw form) may be used to drive intra-prediction angular mode selection, including making a preliminary/coarse angular mode selection (e.g., which may be refined and/or modified based upon partial and/or full processing of the video signal). Characteristic(s) associated with the video signal (raw form) may be used to drive intra-prediction/inter-prediction operational mode selection (or intra-prediction/inter-prediction/neither operational mode selection). An integrated and/or embedded video decoder within a video encoding device may be provisioned to assist in adaptation of one or more of the video encoding operations.

Abstract translation: 基于原始视频数据的高级编码处理。 视频信号的自适应处理可以通过基于与原始形式的视频信号相关联的特性（例如，在根据视频信号进行任何处理之前）进行一个或多个判定和/或指示一个或多个编码步骤 产生输出视频比特流）。 可以使用与视频信号（原始形式）相关联的特征来驱动帧内预测角模式选择，包括进行初步/粗略角度模式选择（例如，可以基于部分和/ 或完全处理视频信号）。 可以使用与视频信号（原始形式）相关联的特征来驱动帧内预测/帧间预测操作模式选择（或帧内预测/帧间预测/两种操作模式选择）。 可以提供视频编码设备内的集成和/或嵌入式视频解码器以帮助适配一个或多个视频编码操作。

公开(公告)号：US20130083839A1

公开(公告)日：2013-04-04

申请号：US13333256

申请日：2011-12-21

Applicant: Zhijie Yang ,  Bhaskar Sherigar Mala Sherigar

Inventor： Zhijie Yang ,  Bhaskar Sherigar Mala Sherigar

IPC: H04N7/26

CPC classification number: H04N19/164 ,  H04N19/103 ,  H04N19/30 ,  H04N19/40 ,  H04N19/86 ,  H04N19/895

Abstract: Video coding tree sub-block splitting. A parser and treeblock splitter is implemented for adaptive partitioning of treeblocks (TBs) into various respective sub-treeblocks (STBs). Such adaptation may be tailored for effectuating parallel processing in accordance with video decoding. Different respective decoding engines may each individually and respectively also perform further partitioning of the STBs into sub-STBs as well. Such adaptation of respective STB size and/or sub-STB size may be made based on local and/or remote consideration(s). For example, adaptation may be made based upon communication link and/or channel conditions, a remote characteristic (e.g., associated with a source device and/or destination device), a local characteristic (e.g., associated with operations and/or processing performed locally within a given device), and/or any other type of consideration. Different respective portions of a video signal may be processed using different respective sized STBs/sub-STBs (and different respective engines may also employ different respective sized STBs/sub-STBs).

Abstract translation: 视频编码树子块分割。 实现解析器和树形块分割器用于将树形块（TB）自适应分割成各种各样的子树块（STB）。 这样的适配可以根据视频解码来实现并行处理。 不同的各个解码引擎​​可以各自单独地并且分别也执行STB的进一步划分成子机顶盒。 各个STB大小和/或子STB大小的这种调整可以基于本地和/或远程考虑来进行。 例如，可以基于通信链路和/或信道条件，远程特性（例如，与源设备和/或目的地设备相关联），本地特性（例如，与本地执行的操作和/或处理相关联）进行适配 在给定的设备内）和/或任何其他类型的考虑。 可以使用不同的相应尺寸的STB /子STB来处理视频信号的不同的各个部分（并且不同的各个引擎也可以使用不同的大小的STB /子机顶盒）。

公开(公告)号：US09693064B2

公开(公告)日：2017-06-27

申请号：US13333424

申请日：2011-12-21

Applicant: Ba-Zhong Shen ,  Wade K. Wan ,  Brian Heng ,  Zhijie Yang

Inventor： Ba-Zhong Shen ,  Wade K. Wan ,  Brian Heng ,  Zhijie Yang

IPC: H04N7/12 ,  H04N19/164 ,  H04N19/30 ,  H04N19/103 ,  H04N19/86 ,  H04N19/40 ,  H04N19/895

CPC classification number: H04N19/164 ,  H04N19/103 ,  H04N19/30 ,  H04N19/40 ,  H04N19/86 ,  H04N19/895

Abstract: Within a device, one or more subsets associated with one or more frames or pictures of the video signal may be adaptively selected and used for motion vector calculation (e.g., such as in accordance with inter-prediction). For example, a picture or frame of the video signal may be partitioned into a number of respective regions. Any one or more, but typically fewer than all, of the respective regions of that picture or frame may be appropriately selected, and stored, based on any one or more considerations for use in motion vector calculation (e.g., inter-prediction). A sub-sampled or down-sampled picture or frame [or alternatively, a sub-sampled or down-sampled version of one or more respective regions of a picture or frame] (e.g., the sub-sampling or down-sampling ratio which may be adaptively determined based on any one or more considerations) may be stored for use in motion vector calculation (e.g., inter-prediction).

公开(公告)号：US09456212B2

公开(公告)日：2016-09-27

申请号：US13333614

申请日：2011-12-21

Applicant: Wade K. Wan ,  Zhijie Yang ,  Brian Heng

Inventor： Wade K. Wan ,  Zhijie Yang ,  Brian Heng

IPC: H04N19/40

CPC classification number: H04N19/40

Abstract: Video coding sub-block sizing based on infrastructure capabilities and current conditions. Sub-block size, such as employed in accordance with the video processing, maybe adaptively modified based on any of a number of considerations. For example, such adaptation of sub-block size may be made with respect to one or more characteristics associated with streaming media source flow(s) and/or streaming media delivery flow(s) being received by and/or output from a given device including a video processor. For example, such a video processor may be a video decoder implemented within a middling or destination device. Such a video processor may be a video encoder implemented within the middling or source device. Adaptation of sub-block size employed in accordance with video coding may also be effectuated in accordance with feedback or control signaling provided between respective devices. (e.g., from destination or source device to middling device, or from destination device to source device, etc.).