公开(公告)号：US08707141B1

公开(公告)日：2014-04-22

申请号：US13196359

申请日：2011-08-02

申请人： Rui Zhang ,  Qiyong Liu ,  Bo Ling ,  Siping Tao

发明人： Rui Zhang ,  Qiyong Liu ,  Bo Ling ,  Siping Tao

IPC分类号： H03M13/00

CPC分类号： H03M13/353 ,  H04N21/2383

摘要： In one embodiment, a process determines a size of a video unit (e.g., frame) to transmit from a sender to a receiver across a communication channel for an associated video stream, and also determines an updated packet loss rate on the channel. In response, the process may dynamically determine both a number N of video data packets and a number M of forward error correction (FEC) packets to transmit for the video unit based on the size of the video unit, the updated packet loss rate on the channel, and an error resilience requirement for the video stream. In an illustrative embodiment, N and M are determined during transmission of the video stream through a look-up operation into a table indexed by the size of the video unit and the updated packet loss rate as co-indices, the co-indices co-indexing a pre-determined N and M pair.

摘要翻译： 在一个实施例中，过程确定通过用于相关联的视频流的通信信道从发送方发送到接收者的视频单元（例如，帧）的大小，并且还确定信道上的更新的丢包率。 作为响应，该过程可以基于视频单元的大小来动态地确定视频数据分组的数量N和数字M的前向纠错（FEC）分组，以便为​​视频单元发送，更新的丢包率 频道和视频流的错误恢复能力要求。 在说明性实施例中，在通过查找操作将视频流传输到由视频单元的大小索引的表和更新的分组丢失率作为共同索引的同时，确定N和M， 索引预定的N和M对。

公开(公告)号：US20130166650A1

公开(公告)日：2013-06-27

申请号：US13609326

申请日：2012-09-11

申请人： Sijia Chen ,  Wayne Liu ,  Siping Tao

发明人： Sijia Chen ,  Wayne Liu ,  Siping Tao

IPC分类号： G06F15/16

CPC分类号： H04N21/234381 ,  H04N19/107 ,  H04N19/164 ,  H04N19/172 ,  H04N21/23406 ,  H04N21/4788 ,  H04N21/8455

摘要： Techniques are provided to improve user experience at endpoint devices that are participating in a multipoint screen content sharing session. A server in a multipoint communication system receives video frames from a sending endpoint device in the communication session that involves one or more other endpoint devices that are to receive video frames from the sending endpoint device. The video frames include key reference frames that use either intra-frame prediction or inter-frame prediction based only on other key reference frames. The server stores the key reference frames. When a new receiving endpoint device joins the communication session, the server sends all the stored key reference frames to the new receiving endpoint device. All video frames received from the sending endpoint device are forwarded to existing ordinary receiving endpoint devices. Key reference frames and some, but not all, non-key reference video frames are forwarded to existing low-capacity receiving endpoint devices.

摘要翻译： 提供技术来改善参与多点屏幕内容共享会话的端点设备的用户体验。 多点通信系统中的服务器从通信会话中的发送端点设备接收视频帧，其涉及要从发送端点设备接收视频帧的一个或多个其他端点设备。 视频帧包括仅基于其他关键参考帧使用帧内预测或帧间预测的关键参考帧。 服务器存储关键参考帧。 当新的接收端点设备加入通信会话时，服务器将所有存储的密钥参考帧发送到新的接收端点设备。 从发送端点设备接收到的所有视频帧都转发到现有的普通接收端点设备。 密钥参考帧和一些但不是全部的非密钥参考视频帧被转发到现有的低容量接收端点设备。

公开(公告)号：US09262986B2

公开(公告)日：2016-02-16

申请号：US13526956

申请日：2012-06-19

申请人： Sijia Chen ,  Sawyer Shan ,  Hui Liu ,  Siping Tao

发明人： Sijia Chen ,  Sawyer Shan ,  Hui Liu ,  Siping Tao

IPC分类号： H04N7/32 ,  G09G5/00 ,  H04N19/105 ,  H04N19/14 ,  H04N19/17 ,  H04N19/189 ,  H04N19/58

CPC分类号： G09G5/001 ,  G09G2340/02 ,  G09G2340/0407 ,  G09G2340/0442 ,  G09G2360/12 ,  G09G2370/10 ,  H04N19/105 ,  H04N19/14 ,  H04N19/17 ,  H04N19/189 ,  H04N19/58

摘要： Techniques are provided for reference frame management for screen content video coding using hash or checksum functions. A video data stream including a plurality of frames is received, each frame including a plurality of pixels that define content within the frame. A plurality of hash code values associated with partitioned portions of a current frame are determined, where each hash code value is determined as an output value from a hash or checksum function based upon an input value comprising pixel values for a corresponding partition within the current frame. The current frame is compared with a plurality of reference frames based upon a comparison of the hash code values of the current frame with hash code values of the reference frames. A reference frame is selected as a candidate reference frame for coding the current frame.

摘要翻译： 提供技术用于使用散列或校验和功能的屏幕内容视频编码的参考帧管理。 接收包括多个帧的视频数据流，每个帧包括定义帧内的内容的多个像素。 确定与当前帧的分割部分相关联的多个哈希代码值，其中基于包括当前帧内的对应分区的像素值的输入值，从哈希或校验和函数确定每个哈希码值作为输出值 。 基于当前帧的哈希码值与参考帧的哈希码值的比较，将当前帧与多个参考帧进行比较。 选择参考帧作为用于对当前帧进行编码的候选参考帧。

公开(公告)号：US09232244B2

公开(公告)日：2016-01-05

申请号：US13609326

申请日：2012-09-11

申请人： Sijia Chen ,  Wayne Liu ,  Siping Tao

发明人： Sijia Chen ,  Wayne Liu ,  Siping Tao

IPC分类号： G06F15/16 ,  H04N21/2343 ,  H04N21/234 ,  H04N21/845 ,  H04N19/172 ,  H04N19/107 ,  H04N19/164 ,  H04N21/4788

CPC分类号： H04N21/234381 ,  H04N19/107 ,  H04N19/164 ,  H04N19/172 ,  H04N21/23406 ,  H04N21/4788 ,  H04N21/8455

摘要： Techniques are provided to improve user experience at endpoint devices that are participating in a multipoint screen content sharing session. A server in a multipoint communication system receives video frames from a sending endpoint device in the communication session that involves one or more other endpoint devices that are to receive video frames from the sending endpoint device. The video frames include key reference frames that use either intra-frame prediction or inter-frame prediction based only on other key reference frames. The server stores the key reference frames. When a new receiving endpoint device joins the communication session, the server sends all the stored key reference frames to the new receiving endpoint device. All video frames received from the sending endpoint device are forwarded to existing ordinary receiving endpoint devices. Key reference frames and some, but not all, non-key reference video frames are forwarded to existing low-capacity receiving endpoint devices.

摘要翻译： 提供技术来改善参与多点屏幕内容共享会话的端点设备的用户体验。 多点通信系统中的服务器从通信会话中的发送端点设备接收视频帧，其涉及要从发送端点设备接收视频帧的一个或多个其他端点设备。 视频帧包括仅基于其他关键参考帧使用帧内预测或帧间预测的关键参考帧。 服务器存储关键参考帧。 当新的接收端点设备加入通信会话时，服务器将所有存储的密钥参考帧发送到新的接收端点设备。 从发送端点设备接收到的所有视频帧都转发到现有的普通接收端点设备。 密钥参考帧和一些但不是全部的非密钥参考视频帧被转发到现有的低容量接收端点设备。

公开(公告)号：US09332271B2

公开(公告)日：2016-05-03

申请号：US13435199

申请日：2012-03-30

申请人： Sijia Chen ,  Kai Li ,  Wayne Liu ,  Siping Tao

发明人： Sijia Chen ,  Kai Li ,  Wayne Liu ,  Siping Tao

IPC分类号： H04N7/32 ,  H04N19/557 ,  H04N19/56 ,  H04N19/533

CPC分类号： H04N19/557 ,  H04N19/533 ,  H04N19/56

摘要： A method, a device and computer readable storage media facilitate providing screen content including a plurality of video frames that are displayed by a computing device. During coding of the screen content, a suitable predictor is found that is used to code pixel blocks from one or more frames. The suitable predictor is found by selecting a pixel block of a current frame, conducting a direction based search by comparing pixel blocks within a search window of a reference frame with the selected pixel block of the current frame to determine whether a match exists, and, in response to a determination that no sufficient match has been found, conducting a feature oriented search by comparing pixel blocks of the reference frame with the selected pixel block of the current frame to find a suitable match based upon a common feature.

摘要翻译： 方法，设备和计算机可读存储介质便于提供包括由计算设备显示的多个视频帧的屏幕内容。 在屏幕内容的编码期间，发现用于从一个或多个帧编码像素块的合适的预测器。 通过选择当前帧的像素块，通过比较参考帧的搜索窗口内的像素块与当前帧的所选像素块来进行基于方向的搜索来确定是否存在匹配来找到合适的预测器， 响应于确定没有发现足够的匹配，通过将参考帧的像素块与当前帧的所选像素块进行比较来进行面向特征的搜索，以基于共同特征找到合适的匹配。

公开(公告)号：US20130114704A1

公开(公告)日：2013-05-09

申请号：US13435199

申请日：2012-03-30

申请人： Sijia Chen ,  Kai Li ,  Wayne Liu ,  Siping Tao

发明人： Sijia Chen ,  Kai Li ,  Wayne Liu ,  Siping Tao

IPC分类号： H04N7/32

CPC分类号： H04N19/557 ,  H04N19/533 ,  H04N19/56

摘要： A method, a device and computer readable storage media facilitate providing screen content including a plurality of video frames that are displayed by a computing device. During coding of the screen content, a suitable predictor is found that is used to code pixel blocks from one or more frames. The suitable predictor is found by selecting a pixel block of a current frame, conducting a direction based search by comparing pixel blocks within a search window of a reference frame with the selected pixel block of the current frame to determine whether a match exists, and, in response to a determination that no sufficient match has been found, conducting a feature oriented search by comparing pixel blocks of the reference frame with the selected pixel block of the current frame to find a suitable match based upon a common feature.

摘要翻译： 方法，设备和计算机可读存储介质便于提供包括由计算设备显示的多个视频帧的屏幕内容。 在屏幕内容的编码期间，发现用于从一个或多个帧编码像素块的合适的预测器。 通过选择当前帧的像素块，通过比较参考帧的搜索窗口内的像素块与当前帧的所选像素块来进行基于方向的搜索来确定是否存在匹配来找到合适的预测器， 响应于确定没有发现足够的匹配，通过将参考帧的像素块与当前帧的所选像素块进行比较来进行面向特征的搜索，以基于共同特征找到合适的匹配。

公开(公告)号：US20130148721A1

公开(公告)日：2013-06-13

申请号：US13526956

申请日：2012-06-19

申请人： Sijia Chen ,  Sawyer Shan ,  Hui Liu ,  Siping Tao

发明人： Sijia Chen ,  Sawyer Shan ,  Hui Liu ,  Siping Tao

IPC分类号： H04N7/32

CPC分类号： G09G5/001 ,  G09G2340/02 ,  G09G2340/0407 ,  G09G2340/0442 ,  G09G2360/12 ,  G09G2370/10 ,  H04N19/105 ,  H04N19/14 ,  H04N19/17 ,  H04N19/189 ,  H04N19/58

摘要： Techniques are provided for reference frame management for screen content video coding using hash or checksum functions. A video data stream including a plurality of frames is received, each frame including a plurality of pixels that define content within the frame. A plurality of hash code values associated with partitioned portions of a current frame are determined, where each hash code value is determined as an output value from a hash or checksum function based upon an input value comprising pixel values for a corresponding partition within the current frame. The current frame is compared with a plurality of reference frames based upon a comparison of the hash code values of the current frame with hash code values of the reference frames. A reference frame is selected as a candidate reference frame for coding the current frame.

摘要翻译： 提供技术用于使用散列或校验和功能的屏幕内容视频编码的参考帧管理。 接收包括多个帧的视频数据流，每个帧包括定义帧内的内容的多个像素。 确定与当前帧的分割部分相关联的多个哈希代码值，其中基于包括当前帧内的对应分区的像素值的输入值，从哈希或校验和函数确定每个哈希码值作为输出值 。 基于当前帧的哈希码值与参考帧的哈希码值的比较，将当前帧与多个参考帧进行比较。 选择参考帧作为用于对当前帧进行编码的候选参考帧。