Application-assisted spatio-temporal error concealment for RTP video

    公开(公告)号:US09756356B2

    公开(公告)日:2017-09-05

    申请号:US14307860

    申请日:2014-06-18

    IPC分类号: H04N19/513 H04N19/895

    CPC分类号: H04N19/521 H04N19/895

    摘要: Systems and methods that employ an application-assisted approach to adaptive spatio-temporal error concealment in video decoders. The systems and methods employ a video receiver that can receive real-time video frames from a video transmitter over a wired and/or wireless network. The video receiver includes an end system configurable as an application for consuming the content of the real-time video frames. The end system application can determine whether each received real-time video frame is complete or incomplete, whether each received slice is complete or incomplete, and provide such information to the video decoder for use in avoiding errors while decoding the respective real-time video frames. The video decoder can determine whether any pixel blocks included in real-time video packets are properly decoded or missing, generate statistics regarding the coding mode of the respective pixel blocks, and use such further information while performing adaptive spatio-temporal error concealment on the respective pixel blocks.

    EFFICIENT PACKET PROCESSING AT VIDEO RECEIVER IN MULTIMEDIA COMMUNICATIONS OVER PACKET NETWORKS
    2.
    发明申请
    EFFICIENT PACKET PROCESSING AT VIDEO RECEIVER IN MULTIMEDIA COMMUNICATIONS OVER PACKET NETWORKS 有权
    多媒体通信在视频接收机上的高效分组处理

    公开(公告)号:US20150244650A1

    公开(公告)日:2015-08-27

    申请号:US14186239

    申请日:2014-02-21

    摘要: Systems and methods of handling packet errors associated with multimedia data received at data receivers from data senders, in which packet error feedback information is provided by the data receivers to the data senders in one or more real-time transport control protocol (RTCP) feedback packets. The data receivers can calculate, determine, or otherwise obtain costs associated with providing specific forms of packet error feedback information in the RTCP feedback packets, and further calculate, determine, or otherwise obtain wait times for handling out-of-order packets, as well as receiving retransmissions of lost packets. By handling packet errors associated with multimedia data while taking into account such costs and wait times, each of which can have an impact on system bandwidth and/or latency, the systems and methods can more reliably achieve the quality of experience (QoE) generally desired and/or required for multimedia data transmissions.

    摘要翻译: 处理与来自数据发送器的数据接收器处接收的多媒体数据相关联的分组错误的系统和方法,其中数据接收器向一个或多个实时传输控制协议(RTCP)反馈分组中的数据发送器提供分组错误反馈信息 。 数据接收器可以计算,确定或以其他方式获得与在RTCP反馈分组中提供特定形式的分组错误反馈信息相关的成本,并且进一步计算,确定或以其他方式获得处理无序分组的等待时间,以及 作为接收丢失数据包的重传。 通过处理与多媒体数据相关联的分组错误,同时考虑到这些成本和等待时间,其中每一个可能对系统带宽和/或延迟产生影响,系统和方法可以更可靠地实现通常期望的体验质量(QoE) 和/或多媒体数据传输所需的。

    Efficient bitrate adaptation in video communications over IP networks

    公开(公告)号:US09609040B2

    公开(公告)日:2017-03-28

    申请号:US14186205

    申请日:2014-02-21

    摘要: Systems and methods of dynamically adapting multimedia data transmit rates of data senders to available bandwidths of data receivers, in which the available bandwidths are estimated by the data senders using at least reception quality feedback information provided in real-time transport control protocol (RTCP) report packets. The data senders can obtain several bandwidth estimation parameters, such as a packet loss ratio and a round trip delay, from the reception quality feedback information, as well as multimedia data transmit rates from the data senders to the data receivers, and obtain estimates of the available bandwidths of the data receivers using at least the bandwidth estimation parameters and multimedia data transmit rates. Further, using the estimated available bandwidth, the data senders can dynamically adapt the multimedia data transmit rates to the available bandwidths for more reliably achieving the quality of experience (QoE) desired and/or required for multimedia data transmissions.

    RESOURCE-ADAPTIVE VIDEO ENCODER SHARING IN MULTIPOINT CONTROL UNIT
    4.
    发明申请
    RESOURCE-ADAPTIVE VIDEO ENCODER SHARING IN MULTIPOINT CONTROL UNIT 有权
    资源自适应视频编码器在多点控制单元中共享

    公开(公告)号:US20140375756A1

    公开(公告)日:2014-12-25

    申请号:US14304144

    申请日:2014-06-13

    摘要: Systems and methods of video conferencing, in which existing video encoders associated with a multipoint control unit (MCU) can be shared among conference participant devices, depending upon the availability of processor and/or memory resources for the MCU. In making decisions regarding the sharing of video encoders, the systems and methods take into account various parameters associated with potential conference participant devices and the total cost of the processor/memory resources for the MCU, to determine whether a video encoder of the MCU can be shared with, or allocated to, the respective conference participant devices. By determining whether to share or allocate a video encoder of the MCU, depending upon the available processor/memory resources for the MCU, the MCU can be made to operate with increased stability. The systems and methods can be applied to any application that sends the same content to multiple receivers, including announcement and video streaming applications.

    摘要翻译: 根据MCU的处理器和/或存储器资源的可用性,视频会议的系统和方法,其中与多点控制单元(MCU)相关联的现有视频编码器可以在会议参与者设备之间共享。 在决定视频编码器的共享时,系统和方法考虑到与潜在的会议参与者设备相关的各种参数以及MCU的处理器/存储器资源的总成本,以确定MCU的视频编码器是否可以 共享或分配给各个会议参与者设备。 通过确定是否共享或分配MCU的视频编码器,根据MCU的可用处理器/内存资源,可以使MCU以更高的稳定性运行。 系统和方法可以应用于将相同内容发送到多个接收器的任何应用程序,包括通知和视频流应用程序。

    Resource-adaptive video encoder sharing in multipoint control unit
    6.
    发明授权
    Resource-adaptive video encoder sharing in multipoint control unit 有权
    多点控制单元资源自适应视频编码器共享

    公开(公告)号:US09210381B2

    公开(公告)日:2015-12-08

    申请号:US14304144

    申请日:2014-06-13

    摘要: Systems and methods of video conferencing, in which existing video encoders associated with a multipoint control unit (MCU) can be shared among conference participant devices, depending upon the availability of processor and/or memory resources for the MCU. In making decisions regarding the sharing of video encoders, the systems and methods take into account various parameters associated with potential conference participant devices and the total cost of the processor/memory resources for the MCU, to determine whether a video encoder of the MCU can be shared with, or allocated to, the respective conference participant devices. By determining whether to share or allocate a video encoder of the MCU, depending upon the available processor/memory resources for the MCU, the MCU can be made to operate with increased stability. The systems and methods can be applied to any application that sends the same content to multiple receivers, including announcement and video streaming applications.

    摘要翻译: 根据MCU的处理器和/或存储器资源的可用性,视频会议的系统和方法,其中与多点控制单元(MCU)相关联的现有视频编码器可以在会议参与者设备之间共享。 在决定视频编码器的共享时,系统和方法考虑到与潜在的会议参与者设备相关的各种参数以及MCU的处理器/存储器资源的总成本,以确定MCU的视频编码器是否可以 共享或分配给各个会议参与者设备。 通过确定是否共享或分配MCU的视频编码器,根据MCU的可用处理器/内存资源,可以使MCU以更高的稳定性运行。 系统和方法可以应用于将相同内容发送到多个接收器的任何应用程序,包括通知和视频流应用程序。

    EFFICIENT BITRATE ADAPTATION IN VIDEO COMMUNICATIONS OVER IP NETWORKS
    7.
    发明申请
    EFFICIENT BITRATE ADAPTATION IN VIDEO COMMUNICATIONS OVER IP NETWORKS 有权
    通过IP网络进行视频通信的高效双边适配

    公开(公告)号:US20150244760A1

    公开(公告)日:2015-08-27

    申请号:US14186205

    申请日:2014-02-21

    IPC分类号: H04L29/06

    摘要: Systems and methods of dynamically adapting multimedia data transmit rates of data senders to available bandwidths of data receivers, in which the available bandwidths are estimated by the data senders using at least reception quality feedback information provided in real-time transport control protocol (RTCP) report packets. The data senders can obtain several bandwidth estimation parameters, such as a packet loss ratio and a round trip delay, from the reception quality feedback information, as well as multimedia data transmit rates from the data senders to the data receivers, and obtain estimates of the available bandwidths of the data receivers using at least the bandwidth estimation parameters and multimedia data transmit rates. Further, using the estimated available bandwidth, the data senders can dynamically adapt the multimedia data transmit rates to the available bandwidths for more reliably achieving the quality of experience (QoE) desired and/or required for multimedia data transmissions.

    摘要翻译: 动态调整多媒体数据的系统和方法将数据发送器的传输速率传输到数据接收器的可用带宽,其中数据发送者至少使用实时传输控制协议(RTCP)报告中提供的接收质量反馈信息来估计可用带宽 数据包 数据发送者可以从接收质量反馈信息中获得诸如分组丢失率和往返延迟的多个带宽估计参数,以及从数据发送者到数据接收者的多媒体数据传输速率,并获得 使用至少带宽估计参数和多媒体数据传输速率的数据接收机的可用带宽。 此外,使用估计的可用带宽,数据发送者可以将多媒体数据传输速率动态地适应于可用带宽,以更可靠地实现多媒体数据传输期望和/或所需的体验质量(QoE)。

    Application-Assisted Spatio-Temporal Error Concealment for RTP Video
    8.
    发明申请
    Application-Assisted Spatio-Temporal Error Concealment for RTP Video 有权
    RTP视频的应用辅助时空错误隐藏

    公开(公告)号:US20140376632A1

    公开(公告)日:2014-12-25

    申请号:US14307860

    申请日:2014-06-18

    IPC分类号: H04N19/89 H04N19/51

    CPC分类号: H04N19/521 H04N19/895

    摘要: Systems and methods that employ an application-assisted approach to adaptive spatio-temporal error concealment in video decoders. The systems and methods employ a video receiver that can receive real-time video frames from a video transmitter over a wired and/or wireless network. The video receiver includes an end system configurable as an application for consuming the content of the real-time video frames. The end system application can determine whether each received real-time video frame is complete or incomplete, whether each received slice is complete or incomplete, and provide such information to the video decoder for use in avoiding errors while decoding the respective real-time video frames. The video decoder can determine whether any pixel blocks included in real-time video packets are properly decoded or missing, generate statistics regarding the coding mode of the respective pixel blocks, and use such further information while performing adaptive spatio-temporal error concealment on the respective pixel blocks.

    摘要翻译: 采用应用辅助方法对视频解码器中的自适应时空错误隐藏的系统和方法。 系统和方法采用可以通过有线和/或无线网络从视频发射机接收实时视频帧的视频接收机。 视频接收器包括可配置为消费实时视频帧的内容的应用的终端系统。 终端系统应用程序可以确定每个接收到的实时视频帧是完整还是不完整,无论每个接收到的片是完整还是不完整的,并且将这些信息提供给视频解码器以用于在解码相应的实时视频帧期间避免错误 。 视频解码器可以确定实时视频分组中包括的任何像素块是否被正确解码或丢失,生成关于各个像素块的编码模式的统计信息,并且在对相应的像素块执行自适应时空误差隐藏的同时使用这样的信息 像素块。