Efficient bitrate adaptation in video communications over IP networks

    公开(公告)号:US09609040B2

    公开(公告)日:2017-03-28

    申请号:US14186205

    申请日:2014-02-21

    摘要: Systems and methods of dynamically adapting multimedia data transmit rates of data senders to available bandwidths of data receivers, in which the available bandwidths are estimated by the data senders using at least reception quality feedback information provided in real-time transport control protocol (RTCP) report packets. The data senders can obtain several bandwidth estimation parameters, such as a packet loss ratio and a round trip delay, from the reception quality feedback information, as well as multimedia data transmit rates from the data senders to the data receivers, and obtain estimates of the available bandwidths of the data receivers using at least the bandwidth estimation parameters and multimedia data transmit rates. Further, using the estimated available bandwidth, the data senders can dynamically adapt the multimedia data transmit rates to the available bandwidths for more reliably achieving the quality of experience (QoE) desired and/or required for multimedia data transmissions.

    RESOURCE-ADAPTIVE VIDEO ENCODER SHARING IN MULTIPOINT CONTROL UNIT
    2.
    发明申请
    RESOURCE-ADAPTIVE VIDEO ENCODER SHARING IN MULTIPOINT CONTROL UNIT 有权
    资源自适应视频编码器在多点控制单元中共享

    公开(公告)号:US20140375756A1

    公开(公告)日:2014-12-25

    申请号:US14304144

    申请日:2014-06-13

    摘要: Systems and methods of video conferencing, in which existing video encoders associated with a multipoint control unit (MCU) can be shared among conference participant devices, depending upon the availability of processor and/or memory resources for the MCU. In making decisions regarding the sharing of video encoders, the systems and methods take into account various parameters associated with potential conference participant devices and the total cost of the processor/memory resources for the MCU, to determine whether a video encoder of the MCU can be shared with, or allocated to, the respective conference participant devices. By determining whether to share or allocate a video encoder of the MCU, depending upon the available processor/memory resources for the MCU, the MCU can be made to operate with increased stability. The systems and methods can be applied to any application that sends the same content to multiple receivers, including announcement and video streaming applications.

    摘要翻译: 根据MCU的处理器和/或存储器资源的可用性,视频会议的系统和方法,其中与多点控制单元(MCU)相关联的现有视频编码器可以在会议参与者设备之间共享。 在决定视频编码器的共享时,系统和方法考虑到与潜在的会议参与者设备相关的各种参数以及MCU的处理器/存储器资源的总成本,以确定MCU的视频编码器是否可以 共享或分配给各个会议参与者设备。 通过确定是否共享或分配MCU的视频编码器,根据MCU的可用处理器/内存资源,可以使MCU以更高的稳定性运行。 系统和方法可以应用于将相同内容发送到多个接收器的任何应用程序,包括通知和视频流应用程序。

    Methods and apparatus for nearly lossless-concatenated block transform coding
    3.
    发明授权
    Methods and apparatus for nearly lossless-concatenated block transform coding 有权
    几乎无损连接的块变换编码的方法和装置

    公开(公告)号:US06909812B1

    公开(公告)日:2005-06-21

    申请号:US09615565

    申请日:2000-07-13

    摘要: Methods and apparatus for performing near lossless-concatenated N-level constrained quantization Hadamard transform decoding are provided. Accordingly, the present invention provides a transform-based coding technique, where the coding loss introduced during repeated encoding and decoding is reduced to a substantially insignificant level. This is accomplished by employing a constrained quantization and inverse quantization operation in each level of encoding/decoding in the decoder. In this manner, the concatenation error between each level of a decoder is reduced to a substantially minimum level and the quantization error introduced during quantization operations, i.e., originally at the encoder and in each level of the decoder, is substantially reduced. Thus, the decoded bit stream that is output at the N-th level of the decoder is substantially the same as the original bit stream provided to the input of the encoder.

    摘要翻译: 用于执行近无损级联的N级约束量化的方法和装置提供了Hadamard变换解码。 因此,本发明提供了一种基于变换的编码技术,其中在重复编码和解码期间引入的编码损耗降低到基本上不显着的水平。 这通过在解码器中的每个编码/解码级中采用约束量化和逆量化操作来实现。 以这种方式,将解码器的每个电平之间的级联误差减小到基本上最小的电平,并且在量化操作期间引入的量化误差,即最初在编码器处和解码器的每个电平中引入的量化误差被大大减少。 因此,在解码器的第N级输出的解码比特流与提供给编码器的输入的原始比特流基本相同。

    RATE CONTROL ALGORITHM FOR SCALABLE VIDEO ENCODING WITH DISPOSABLE P-FRAMES

    公开(公告)号:US20170118474A1

    公开(公告)日:2017-04-27

    申请号:US15401243

    申请日:2017-01-09

    摘要: Systems and methods of performing rate control in scalable video encoders that can be used to provide videoconferencing, announcements, and live video streaming to multiple participant devices having diverse bandwidths, resolutions, and/or other device characteristics. The systems and methods can accommodate different target bit rates of the multiple participant devices by operating on scalable video bitstreams in a multi-layer video format, including a base layer having one or more reference video frames, and an enhancement layer having one or more disposable non-reference, predictive video frames. By adjusting the number of disposable non-reference, predictive video frames in the enhancement layer, as well as quantization parameters for the respective base and enhancement layers, the disclosed systems and methods can accommodate the different target bit rates for the respective participant devices, while enhancing the spatial and/or temporal qualities of the base and enhancement layers in the respective video bitstreams.

    Resource-adaptive video encoder sharing in multipoint control unit
    5.
    发明授权
    Resource-adaptive video encoder sharing in multipoint control unit 有权
    多点控制单元资源自适应视频编码器共享

    公开(公告)号:US09210381B2

    公开(公告)日:2015-12-08

    申请号:US14304144

    申请日:2014-06-13

    摘要: Systems and methods of video conferencing, in which existing video encoders associated with a multipoint control unit (MCU) can be shared among conference participant devices, depending upon the availability of processor and/or memory resources for the MCU. In making decisions regarding the sharing of video encoders, the systems and methods take into account various parameters associated with potential conference participant devices and the total cost of the processor/memory resources for the MCU, to determine whether a video encoder of the MCU can be shared with, or allocated to, the respective conference participant devices. By determining whether to share or allocate a video encoder of the MCU, depending upon the available processor/memory resources for the MCU, the MCU can be made to operate with increased stability. The systems and methods can be applied to any application that sends the same content to multiple receivers, including announcement and video streaming applications.

    摘要翻译: 根据MCU的处理器和/或存储器资源的可用性,视频会议的系统和方法,其中与多点控制单元(MCU)相关联的现有视频编码器可以在会议参与者设备之间共享。 在决定视频编码器的共享时,系统和方法考虑到与潜在的会议参与者设备相关的各种参数以及MCU的处理器/存储器资源的总成本,以确定MCU的视频编码器是否可以 共享或分配给各个会议参与者设备。 通过确定是否共享或分配MCU的视频编码器,根据MCU的可用处理器/内存资源,可以使MCU以更高的稳定性运行。 系统和方法可以应用于将相同内容发送到多个接收器的任何应用程序,包括通知和视频流应用程序。

    EFFICIENT BITRATE ADAPTATION IN VIDEO COMMUNICATIONS OVER IP NETWORKS
    6.
    发明申请
    EFFICIENT BITRATE ADAPTATION IN VIDEO COMMUNICATIONS OVER IP NETWORKS 有权
    通过IP网络进行视频通信的高效双边适配

    公开(公告)号:US20150244760A1

    公开(公告)日:2015-08-27

    申请号:US14186205

    申请日:2014-02-21

    IPC分类号: H04L29/06

    摘要: Systems and methods of dynamically adapting multimedia data transmit rates of data senders to available bandwidths of data receivers, in which the available bandwidths are estimated by the data senders using at least reception quality feedback information provided in real-time transport control protocol (RTCP) report packets. The data senders can obtain several bandwidth estimation parameters, such as a packet loss ratio and a round trip delay, from the reception quality feedback information, as well as multimedia data transmit rates from the data senders to the data receivers, and obtain estimates of the available bandwidths of the data receivers using at least the bandwidth estimation parameters and multimedia data transmit rates. Further, using the estimated available bandwidth, the data senders can dynamically adapt the multimedia data transmit rates to the available bandwidths for more reliably achieving the quality of experience (QoE) desired and/or required for multimedia data transmissions.

    摘要翻译: 动态调整多媒体数据的系统和方法将数据发送器的传输速率传输到数据接收器的可用带宽,其中数据发送者至少使用实时传输控制协议(RTCP)报告中提供的接收质量反馈信息来估计可用带宽 数据包 数据发送者可以从接收质量反馈信息中获得诸如分组丢失率和往返延迟的多个带宽估计参数,以及从数据发送者到数据接收者的多媒体数据传输速率,并获得 使用至少带宽估计参数和多媒体数据传输速率的数据接收机的可用带宽。 此外,使用估计的可用带宽,数据发送者可以将多媒体数据传输速率动态地适应于可用带宽,以更可靠地实现多媒体数据传输期望和/或所需的体验质量(QoE)。

    Application-Assisted Spatio-Temporal Error Concealment for RTP Video
    7.
    发明申请
    Application-Assisted Spatio-Temporal Error Concealment for RTP Video 有权
    RTP视频的应用辅助时空错误隐藏

    公开(公告)号:US20140376632A1

    公开(公告)日:2014-12-25

    申请号:US14307860

    申请日:2014-06-18

    IPC分类号: H04N19/89 H04N19/51

    CPC分类号: H04N19/521 H04N19/895

    摘要: Systems and methods that employ an application-assisted approach to adaptive spatio-temporal error concealment in video decoders. The systems and methods employ a video receiver that can receive real-time video frames from a video transmitter over a wired and/or wireless network. The video receiver includes an end system configurable as an application for consuming the content of the real-time video frames. The end system application can determine whether each received real-time video frame is complete or incomplete, whether each received slice is complete or incomplete, and provide such information to the video decoder for use in avoiding errors while decoding the respective real-time video frames. The video decoder can determine whether any pixel blocks included in real-time video packets are properly decoded or missing, generate statistics regarding the coding mode of the respective pixel blocks, and use such further information while performing adaptive spatio-temporal error concealment on the respective pixel blocks.

    摘要翻译: 采用应用辅助方法对视频解码器中的自适应时空错误隐藏的系统和方法。 系统和方法采用可以通过有线和/或无线网络从视频发射机接收实时视频帧的视频接收机。 视频接收器包括可配置为消费实时视频帧的内容的应用的终端系统。 终端系统应用程序可以确定每个接收到的实时视频帧是完整还是不完整,无论每个接收到的片是完整还是不完整的,并且将这些信息提供给视频解码器以用于在解码相应的实时视频帧期间避免错误 。 视频解码器可以确定实时视频分组中包括的任何像素块是否被正确解码或丢失,生成关于各个像素块的编码模式的统计信息,并且在对相应的像素块执行自适应时空误差隐藏的同时使用这样的信息 像素块。

    Methods and apparatus for context-based perceptual quantization
    10.
    发明授权
    Methods and apparatus for context-based perceptual quantization 有权
    基于上下文感知量化的方法和装置

    公开(公告)号:US06363113B1

    公开(公告)日:2002-03-26

    申请号:US09326874

    申请日:1999-06-07

    IPC分类号: H04N724

    摘要: A method of perceptually quantizing a block of an image or video sequence includes generating a non-perceptibility of distortion value. The non-perceptibility of distortion value is calculated from one or more masking values, e.g., complexity, brightness, movement, etc., which themselves are respectively calculated from previously reconstructed samples associated with the image or video sequence. The reconstructed samples form one or more causal templates that are used to calculate such masking effects and, thus, the non-perceptibility of distortion value. The perceptual quantization method then includes generating a quantization step size value which is a function of the non-perceptibility of distortion value. Since templates consisting only of previously reconstructed samples are used to derive the quantization step size value, the templates used at the encoder are also available at the decoder. As a result, an encoder does not need to provide quantization-related information to the corresponding decoder since the decoder can get the information using the same causal templates as those used at the encoder.

    摘要翻译: 感知量化图像或视频序列的块的方法包括产生失真值的不可感知性。 失真值的不可感知性是从一个或多个屏蔽值计算的,例如复杂度,亮度,移动等,它们本身分别是从与图像或视频序列相关联的先前重建的样本分别计算的。 重建的样本形成一个或多个因果模板,用于计算这种掩蔽效应,因此计算失真值的不可感知性。 感知量化方法然后包括生成作为失真值的不可感知性的函数的量化步长值。 由于仅使用先前重建的样本的模板用于导出量化步长值,编码器使用的模板在解码器中也可用。 结果,编码器不需要向相应的解码器提供与量化有关的信息,因为解码器可以使用与在编码器中使用的相同的因果模板获得信息。