公开(公告)号：US08893207B2

公开(公告)日：2014-11-18

申请号：US11999461

申请日：2007-12-05

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/173

CPC分类号： A63F13/355 ,  A63F13/12 ,  A63F13/335 ,  A63F13/358 ,  A63F2300/402 ,  A63F2300/552 ,  H04L47/25 ,  H04L65/605 ,  H04L65/607 ,  H04L65/80 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/137 ,  H04N19/14 ,  H04N19/152 ,  H04N19/159 ,  H04N19/169 ,  H04N19/172 ,  H04N19/436 ,  H04N19/61 ,  H04N19/85 ,  H04N21/226 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6587 ,  H04W4/00 ,  H04W28/06

摘要： A server center for hosting low-latency streaming interactive audio/video (NV) includes a plurality of servers that run one or more applications an inbound routing network that receives packet streams from users via a first network interface and routes the packets to one or more of the servers. The packet streams include user control input. One or more of the servers are operable to compute A/V data responsive to the user control input. A compression unit is coupled to receive the A/V data from the one or more of the servers and output compressed A/V data therefrom. An output routing network that routes the compressed A/V data to each of the users over a corresponding communication channel via a second interface, the compression unit is operable to modify a compression rate responsive to current characteristics of the corresponding communication channel for each user so as to optimize performance of the one or more applications.

摘要翻译： 用于托管低延迟流交互式音频/视频（NV）的服务器中心包括运行一个或多个应用的​​多个服务器，入站路由网络经由第一网络接口从用户接收分组流，并将分组路由到一个或多个 的服务器。 分组流包括用户控制输入。 一个或多个服务器可操作以响应于用户控制输入来计算A / V数据。 压缩单元被耦合以从一个或多个服务器接收A / V数据并从其输出压缩的A / V数据。 一种输出路由网络，其经由第二接口将压缩的A / V数据路由到相应通信信道上的每个用户，所述压缩单元可操作以响应于每个用户的相应通信信道的当前特性来修改压缩率，因此 以优化一个或多个应用程序的性能。

公开(公告)号：US20140226713A1

公开(公告)日：2014-08-14

申请号：US14253357

申请日：2014-04-15

申请人： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Rob McCool ,  Ian Buckley

发明人： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Rob McCool ,  Ian Buckley

IPC分类号： H04N19/164

CPC分类号： H04N19/164 ,  A63F13/12 ,  A63F13/25 ,  A63F13/32 ,  A63F13/355 ,  A63F13/358 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587

摘要： A computer-implemented system and method for performing video compression are described. For example, a method according to one embodiment comprises: encoding a plurality of video frames or portions thereof according to a first encoding format; transmitting the plurality of encoded video frames or portions to a client device; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames or portions has been successfully received and/or decoded; in response to detecting that one or more video frames or portions thereof have not been successfully received and/or decoded, determining a number of video frames or portions thereof which have not been successfully received and/or decoded and: (1) if the number of video frames or portions thereof which have not been successfully received and/or decoded is above a specified threshold, then encoding a new video frame or portion thereof according to a second encoding format, the second encoding format comprising a format which is not dependent on previously-transmitted video frames or portions thereof; or (2) if the number of video frames or portions thereof which have not been successfully received and/or decoded is below a specified threshold, then encoding a new video frame or portion thereof according to the first encoding format, the new video frame encoded to be dependent on a last known successfully received video frame or portion thereof; and transmitting the new video frame or portion thereof to the client device.

摘要翻译： 描述了用于执行视频压缩的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：根据第一编码格式对多个视频帧或其部分进行编码; 将多个编码视频帧或部分发送到客户端设备; 从所述客户端设备接收反馈信息，所述反馈信息可用于确定包含在所述视频帧或部分中的数据是否已被成功接收和/或解码; 响应于检测到一个或多个视频帧或其部分未被成功接收和/或解码，确定尚未成功接收和/或解码的视频帧或其部分的数量，并且：（1）如果该数字 尚未成功接收和/或解码的视频帧或其部分高于规定的阈值，然后根据第二编码格式对新的视频帧或其部分进行编码，第二编码格式包括不依赖于 先前传输的视频帧或其部分; 或（2）如果没有成功接收和/或解码的视频帧或其部分的数量低于指定的阈值，则根据第一编码格式对新的视频帧或其部分进行编码，编码的新的视频帧 取决于最后已知的成功接收的视频帧或其部分; 以及将新的视频帧或其一部分发送到客户端设备。

公开(公告)号：US08606942B2

公开(公告)日：2013-12-10

申请号：US12359154

申请日：2009-01-23

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： G06F15/16

CPC分类号： A63F13/87 ,  A63F13/12 ,  A63F13/20 ,  A63F13/30 ,  A63F13/33 ,  A63F13/335 ,  A63F13/35 ,  A63F13/352 ,  A63F13/355 ,  A63F13/358 ,  A63F13/49 ,  A63F2300/402 ,  A63F2300/513 ,  A63F2300/538 ,  A63F2300/552 ,  H04L65/4076 ,  H04L65/605 ,  H04L65/607 ,  H04L65/608 ,  H04L67/38 ,  H04N7/106 ,  H04N21/21 ,  H04N21/2143 ,  H04N21/23 ,  H04N21/4781 ,  H04N21/6125 ,  H04W84/12 ,  H04W88/14

摘要： A system and method are described for intelligently allocating client requests to server centers provide real-time streaming interactive video. For example, one embodiment of a computer-implemented method comprises: strategically positioning a plurality of application server centers at different geographical locations; receiving a request from a client to execute an online application; determining the latency requirements based on the type of application requested by the client; and forwarding the client request to a particular application server center within the plurality based at least on the latency requirements of the requested application.

摘要翻译： 描述了一种系统和方法，用于智能地将客户端请求分配给服务器中心，提供实时流式交互式视频。 例如，计算机实现的方法的一个实施例包括：在不同的地理位置策略地定位多个应用服务器中心; 接收客户端执行在线申请的请求; 根据客户端请求的应用类型确定延迟要求; 以及基于所请求的应用的等待时间要求，将所述客户端请求转发到所述多个基站内的特定应用服务器中心。

公开(公告)号：US20090228946A1

公开(公告)日：2009-09-10

申请号：US12359187

申请日：2009-01-23

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/173

CPC分类号： A63F13/87 ,  A63F13/12 ,  A63F13/20 ,  A63F13/30 ,  A63F13/33 ,  A63F13/335 ,  A63F13/35 ,  A63F13/352 ,  A63F13/355 ,  A63F13/358 ,  A63F13/49 ,  A63F2300/402 ,  A63F2300/513 ,  A63F2300/538 ,  A63F2300/552 ,  H04L65/4076 ,  H04L65/605 ,  H04L65/607 ,  H04L65/608 ,  H04L67/38 ,  H04N7/106 ,  H04N21/21 ,  H04N21/2143 ,  H04N21/23 ,  H04N21/4781 ,  H04N21/6125 ,  H04W84/12 ,  H04W88/14

摘要： An apparatus is described comprising a Power-over-Ethernet interface, a High-Definition Media Interface (HDMI), a Bluetooth interface, a means for decompressing low-latency streaming interactive video and audio from an Internet-based hosting service and outputting the decompressed audio and video through HDMI, and a means for transmitting to the Internet-based hosting service user control information and statistics from received packets. Further, the apparatus is able to receive two interleaved streams of low-latency streaming interactive video.

摘要翻译： 描述了一种装置，其包括以太网供电接口，高清晰度媒体接口（HDMI），蓝牙接口，用于从基于因特网的主机服务解压缩低延迟流交互视频和音频的装置，并输出解压缩 通过HDMI的音频和视频，以及用于从接收到的分组向基于因特网的主机服务用户控制信息和统计信息发送的装置。 此外，该装置能够接收两个低延迟流交互式视频的交错流。

公开(公告)号：US20090225828A1

公开(公告)日：2009-09-10

申请号：US12359127

申请日：2009-01-23

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/26

CPC分类号： A63F13/87 ,  A63F13/12 ,  A63F13/20 ,  A63F13/30 ,  A63F13/33 ,  A63F13/335 ,  A63F13/35 ,  A63F13/352 ,  A63F13/355 ,  A63F13/358 ,  A63F13/49 ,  A63F2300/402 ,  A63F2300/513 ,  A63F2300/538 ,  A63F2300/552 ,  H04L65/4076 ,  H04L65/605 ,  H04L65/607 ,  H04L65/608 ,  H04L67/38 ,  H04N7/106 ,  H04N21/21 ,  H04N21/2143 ,  H04N21/23 ,  H04N21/4781 ,  H04N21/6125 ,  H04W84/12 ,  H04W88/14

摘要： A system and method are described below for encoding interactive low-latency video using interframe coding. For example, one embodiment of a computer-implemented method for performing video compression comprises: detecting a maximum data rate of a communication channel between a server and a client; transmitting a video stream comprising a series of sequential frames from the server to the client; detecting that the maximum data rate will be exceeded if a particular frame of the sequence of frames is transmitted from the server to the client over the communication channel; and in lieu of transmitting the frame which could cause the maximum data rate to be exceeded, causing the client to re-render the previous frame of the sequence of frames, thereby effectively reducing the frame rate of the video stream rendered on the client.

摘要翻译： 下面描述用于使用帧间编码对交互式低延迟视频进行编码的系统和方法。 例如，用于执行视频压缩的计算机实现的方法的一个实施例包括：检测服务器和客户端之间的通信信道的最大数据速率; 从服务器向客户端发送包括一系列连续帧的视频流; 检测到如果帧序列的特定帧通过通信信道从服务器发送到客户端，则将超过最大数据速率; 并且代替发送可能导致最大数据速率的帧的帧，导致客户端重新呈现帧序列的先前帧，从而有效地降低了在客户端上呈现的视频流的帧速率。

公开(公告)号：US20090220002A1

公开(公告)日：2009-09-03

申请号：US12359226

申请日：2009-01-23

申请人： Roger van der Laan ,  Stephen G. Perlman

发明人： Roger van der Laan ,  Stephen G. Perlman

IPC分类号： H04N7/12

CPC分类号： A63F13/87 ,  A63F13/12 ,  A63F13/20 ,  A63F13/30 ,  A63F13/33 ,  A63F13/335 ,  A63F13/35 ,  A63F13/352 ,  A63F13/355 ,  A63F13/358 ,  A63F13/49 ,  A63F2300/402 ,  A63F2300/513 ,  A63F2300/538 ,  A63F2300/552 ,  H04L65/4076 ,  H04L65/605 ,  H04L65/607 ,  H04L65/608 ,  H04L67/38 ,  H04N7/106 ,  H04N21/21 ,  H04N21/2143 ,  H04N21/23 ,  H04N21/4781 ,  H04N21/6125 ,  H04W84/12 ,  H04W88/14

摘要： A system and method are described below for encoding interactive low-latency video using interframe coding. For example, one embodiment of a computer-implemented method for performing video compression comprises: logically subdividing each of a sequence of images into a plurality of tiles, each of the tiles having a defined position within each of the sequence of images, the defined position remaining the same between successive images; detecting motion within the sequence of images occurring at each of the positions of each of the tiles; and encoding each tile within each image of the sequence of images using a first compression format or a second compression format, wherein the frequency at which a particular tile is encoded according to the first compression format across the sequence of images is based on the detected amount of motion at the position of that tile across the sequence of images.

摘要翻译： 下面描述用于使用帧间编码对交互式低延迟视频进行编码的系统和方法。 例如，用于执行视频压缩的计算机实现的方法的一个实施例包括：逻辑上将图像序列中的每一个细分为多个瓦片，每个瓦片在每个图像序列内具有定义的位置，所定义的位置 在连续图像之间保持相同; 检测在每个瓦片的每个位置处发生的图像序列内的运动; 以及使用第一压缩格式或第二压缩格式来对所述图像序列的每个图像内的每个图像进行编码，其中根据所述图像序列根据所述第一压缩格式对特定图块进行编码的频率基于所检测的量 在该图块的位置处的图像序列的运动。

公开(公告)号：US20090119736A1

公开(公告)日：2009-05-07

申请号：US11999461

申请日：2007-12-05

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/20

CPC分类号： A63F13/355 ,  A63F13/12 ,  A63F13/335 ,  A63F13/358 ,  A63F2300/402 ,  A63F2300/552 ,  H04L47/25 ,  H04L65/605 ,  H04L65/607 ,  H04L65/80 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/137 ,  H04N19/14 ,  H04N19/152 ,  H04N19/159 ,  H04N19/169 ,  H04N19/172 ,  H04N19/436 ,  H04N19/61 ,  H04N19/85 ,  H04N21/226 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6587 ,  H04W4/00 ,  H04W28/06

摘要： A server center for hosting low-latency streaming interactive audio/video (A/V) includes a plurality of servers that run one or more applications and an inbound routing network that receives packet streams from users via a first network interface and routes the packets to one or more of the servers. The packet streams include user control input. One or more of the servers are operable to compute A/V data responsive to the user control input. A compression unit is coupled to receive the A/V data from the one or more of the servers and output compressed A/V data therefrom. An output routing network that routes the compressed A/V data to each of the users over a corresponding communication channel via a second interface, the compression unit is operable to modify a compression rate responsive to current characteristics of the corresponding communication channel for each user so as to optimize performance of the one or more applications.

摘要翻译： 用于托管低延迟流交互式音频/视频（A / V）的服务器中心包括运行一个或多个应用的​​多个服务器和经由第一网络接口从用户接收分组流的入站路由网络，并将分组路由到 一个或多个服务器。 分组流包括用户控制输入。 一个或多个服务器可操作以响应于用户控制输入来计算A / V数据。 压缩单元被耦合以从一个或多个服务器接收A / V数据并从其输出压缩的A / V数据。 一种输出路由网络，其经由第二接口将压缩的A / V数据路由到相应通信信道上的每个用户，所述压缩单元可操作以响应于每个用户对应的通信信道的当前特性来修改压缩率，因此 以优化一个或多个应用程序的性能。

公开(公告)号：US10130891B2

公开(公告)日：2018-11-20

申请号：US12359127

申请日：2009-01-23

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： A63F13/355 ,  A63F13/358 ,  A63F13/71 ,  A63F13/87 ,  A63F13/352 ,  A63F13/30 ,  H04L29/06 ,  A63F13/335 ,  A63F13/33 ,  A63F13/35 ,  H04N21/21 ,  H04N21/214 ,  H04N21/23 ,  H04N21/478 ,  H04N21/61 ,  A63F13/20 ,  A63F13/49 ,  H04N7/10 ,  H04W84/12 ,  H04W88/14

摘要： A system and method are described below for encoding interactive low-latency video using interframe coding. For example, one embodiment of a computer-implemented method for performing video compression comprises: detecting a maximum data rate of a communication channel between a server and a client; transmitting a video stream comprising a series of sequential frames from the server to the client; detecting that the maximum data rate will be exceeded if a particular frame of the sequence of frames is transmitted from the server to the client over the communication channel; and in lieu of transmitting the frame which could cause the maximum data rate to be exceeded, causing the client to re-render the previous frame of the sequence of frames, thereby effectively reducing the frame rate of the video stream rendered on the client.

公开(公告)号：US09956490B2

公开(公告)日：2018-05-01

申请号：US12359171

申请日：2009-01-23

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： A63F13/87 ,  H04L29/06 ,  A63F13/355 ,  A63F13/358 ,  A63F13/352 ,  A63F13/30 ,  A63F13/335 ,  A63F13/33 ,  A63F13/35 ,  H04N21/21 ,  H04N21/214 ,  H04N21/23 ,  H04N21/478 ,  H04N21/61 ,  A63F13/20 ,  A63F13/49 ,  H04N7/10 ,  H04W84/12 ,  H04W88/14

CPC分类号： A63F13/87 ,  A63F13/12 ,  A63F13/20 ,  A63F13/30 ,  A63F13/33 ,  A63F13/335 ,  A63F13/35 ,  A63F13/352 ,  A63F13/355 ,  A63F13/358 ,  A63F13/49 ,  A63F2300/402 ,  A63F2300/513 ,  A63F2300/538 ,  A63F2300/552 ,  H04L65/4076 ,  H04L65/605 ,  H04L65/607 ,  H04L65/608 ,  H04L67/38 ,  H04N7/106 ,  H04N21/21 ,  H04N21/2143 ,  H04N21/23 ,  H04N21/4781 ,  H04N21/6125 ,  H04W84/12 ,  H04W88/14

摘要： A system and method are described for storing program code and data within an application hosting center. For example, one embodiment of a computer-implemented method comprises: subdividing program code and/or data used to execute an online application into a first type and a second type; storing program code and data of the first type in a first type of memory, the first type of memory providing relatively low latency memory access; storing program code and data of the second type in a second type of memory, the second type of memory providing relatively higher latency memory access compared to the first type of memory; retrieving program code and data from the first memory and the second memory in response to a client request to execute an online application; and transmitting a streaming interactive video stream representing images generated by the application to the client.

公开(公告)号：US09108107B2

公开(公告)日：2015-08-18

申请号：US11999475

申请日：2007-12-05

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/20 ,  A63F13/30 ,  H04N21/214 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/43 ,  H04N21/439 ,  H04N21/478 ,  H04N21/61 ,  H04N21/6377 ,  H04N21/6405 ,  H04N21/658 ,  H04N21/6587 ,  H04L29/06 ,  H04N19/172 ,  H04N19/169 ,  H04N19/61 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/436 ,  H04N7/10 ,  H04W28/16 ,  H04W84/12

CPC分类号： A63F13/358 ,  A63F9/24 ,  A63F13/12 ,  A63F13/335 ,  A63F13/355 ,  A63F13/52 ,  A63F2009/245 ,  A63F2009/247 ,  A63F2009/2488 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/552 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/69 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/10 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2143 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/262 ,  H04N21/4307 ,  H04N21/439 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6377 ,  H04N21/6405 ,  H04N21/658 ,  H04N21/6587 ,  H04W28/16 ,  H04W84/12

摘要： A method comprising broadcasting a live game tournament in the form of a multicasted streaming interactive video stream from a hosting service to a plurality of viewers over the Internet. Audio from an announcer is overlaid by the hosting service onto the multicasted video stream.