摘要:
Systems and methods of handling packet errors associated with multimedia data received at data receivers from data senders, in which packet error feedback information is provided by the data receivers to the data senders in one or more real-time transport control protocol (RTCP) feedback packets. The data receivers can calculate, determine, or otherwise obtain costs associated with providing specific forms of packet error feedback information in the RTCP feedback packets, and further calculate, determine, or otherwise obtain wait times for handling out-of-order packets, as well as receiving retransmissions of lost packets. By handling packet errors associated with multimedia data while taking into account such costs and wait times, each of which can have an impact on system bandwidth and/or latency, the systems and methods can more reliably achieve the quality of experience (QoE) generally desired and/or required for multimedia data transmissions.
摘要:
Systems and methods of dynamically adapting multimedia data transmit rates of data senders to available bandwidths of data receivers, in which the available bandwidths are estimated by the data senders using at least reception quality feedback information provided in real-time transport control protocol (RTCP) report packets. The data senders can obtain several bandwidth estimation parameters, such as a packet loss ratio and a round trip delay, from the reception quality feedback information, as well as multimedia data transmit rates from the data senders to the data receivers, and obtain estimates of the available bandwidths of the data receivers using at least the bandwidth estimation parameters and multimedia data transmit rates. Further, using the estimated available bandwidth, the data senders can dynamically adapt the multimedia data transmit rates to the available bandwidths for more reliably achieving the quality of experience (QoE) desired and/or required for multimedia data transmissions.
摘要:
Systems and methods of video conferencing, in which existing video encoders associated with a multipoint control unit (MCU) can be shared among conference participant devices, depending upon the availability of processor and/or memory resources for the MCU. In making decisions regarding the sharing of video encoders, the systems and methods take into account various parameters associated with potential conference participant devices and the total cost of the processor/memory resources for the MCU, to determine whether a video encoder of the MCU can be shared with, or allocated to, the respective conference participant devices. By determining whether to share or allocate a video encoder of the MCU, depending upon the available processor/memory resources for the MCU, the MCU can be made to operate with increased stability. The systems and methods can be applied to any application that sends the same content to multiple receivers, including announcement and video streaming applications.
摘要:
Systems and methods that employ an application-assisted approach to adaptive spatio-temporal error concealment in video decoders. The systems and methods employ a video receiver that can receive real-time video frames from a video transmitter over a wired and/or wireless network. The video receiver includes an end system configurable as an application for consuming the content of the real-time video frames. The end system application can determine whether each received real-time video frame is complete or incomplete, whether each received slice is complete or incomplete, and provide such information to the video decoder for use in avoiding errors while decoding the respective real-time video frames. The video decoder can determine whether any pixel blocks included in real-time video packets are properly decoded or missing, generate statistics regarding the coding mode of the respective pixel blocks, and use such further information while performing adaptive spatio-temporal error concealment on the respective pixel blocks.
摘要:
Systems and methods of handling packet errors associated with multimedia data received at data receivers from data senders, in which packet error feedback information is provided by the data receivers to the data senders in one or more real-time transport control protocol (RTCP) feedback packets. The data receivers can calculate, determine, or otherwise obtain costs associated with providing specific forms of packet error feedback information in the RTCP feedback packets, and further calculate, determine, or otherwise obtain wait times for handling out-of-order packets, as well as receiving retransmissions of lost packets. By handling packet errors associated with multimedia data while taking into account such costs and wait times, each of which can have an impact on system bandwidth and/or latency, the systems and methods can more reliably achieve the quality of experience (QoE) generally desired and/or required for multimedia data transmissions.
摘要:
Systems and methods of video conferencing, in which existing video encoders associated with a multipoint control unit (MCU) can be shared among conference participant devices, depending upon the availability of processor and/or memory resources for the MCU. In making decisions regarding the sharing of video encoders, the systems and methods take into account various parameters associated with potential conference participant devices and the total cost of the processor/memory resources for the MCU, to determine whether a video encoder of the MCU can be shared with, or allocated to, the respective conference participant devices. By determining whether to share or allocate a video encoder of the MCU, depending upon the available processor/memory resources for the MCU, the MCU can be made to operate with increased stability. The systems and methods can be applied to any application that sends the same content to multiple receivers, including announcement and video streaming applications.
摘要:
Systems and methods of dynamically adapting multimedia data transmit rates of data senders to available bandwidths of data receivers, in which the available bandwidths are estimated by the data senders using at least reception quality feedback information provided in real-time transport control protocol (RTCP) report packets. The data senders can obtain several bandwidth estimation parameters, such as a packet loss ratio and a round trip delay, from the reception quality feedback information, as well as multimedia data transmit rates from the data senders to the data receivers, and obtain estimates of the available bandwidths of the data receivers using at least the bandwidth estimation parameters and multimedia data transmit rates. Further, using the estimated available bandwidth, the data senders can dynamically adapt the multimedia data transmit rates to the available bandwidths for more reliably achieving the quality of experience (QoE) desired and/or required for multimedia data transmissions.
摘要:
Systems and methods that employ an application-assisted approach to adaptive spatio-temporal error concealment in video decoders. The systems and methods employ a video receiver that can receive real-time video frames from a video transmitter over a wired and/or wireless network. The video receiver includes an end system configurable as an application for consuming the content of the real-time video frames. The end system application can determine whether each received real-time video frame is complete or incomplete, whether each received slice is complete or incomplete, and provide such information to the video decoder for use in avoiding errors while decoding the respective real-time video frames. The video decoder can determine whether any pixel blocks included in real-time video packets are properly decoded or missing, generate statistics regarding the coding mode of the respective pixel blocks, and use such further information while performing adaptive spatio-temporal error concealment on the respective pixel blocks.
摘要:
Provided are methods and systems for rate-distortion optimized quantization and for skipping transform blocks that can take into account the rate-distortion tradeoff as well as the perceptual quality of reconstructed video.
摘要:
A rate control algorithm for a predictive video encoder is provided to accurately control the coding rate while requiring a small complexity. The algorithm assumes the video encoder to consist of two processors, pre-processor and main processor, and the rate control located in main processor uses prediction cost and residual cost for each picture that are computed in pre-processor. Prediction cost represents the estimated number of bits needed to generate an error image, and residual cost describes the difficulty of encoding the resultant error image. Accurate and simple rate control is made possible by using a new rate model that adapts to the local characteristic of a video sequence, and by targeting to maintain the quantization parameter as constant as possible in a given set of pictures, GOP, instead of the conventional two step approach.