公开(公告)号：US09032465B2

公开(公告)日：2015-05-12

申请号：US11999417

申请日：2007-12-05

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/173 ,  A63F13/30 ,  H04L12/841 ,  H04N21/222 ,  H04N21/2343 ,  H04N21/238 ,  H04N21/24 ,  H04N21/478 ,  H04N21/61 ,  H04N21/6587 ,  H04N21/8545 ,  H04L29/06 ,  H04N7/10 ,  H04W4/06 ,  H04W28/16 ,  H04W84/12

CPC分类号： A63F13/358 ,  A63F13/12 ,  A63F13/335 ,  A63F13/35 ,  A63F13/86 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/531 ,  A63F2300/552 ,  A63F2300/577 ,  A63F2300/634 ,  H04L47/283 ,  H04L65/4076 ,  H04L65/602 ,  H04L65/80 ,  H04L67/38 ,  H04N7/106 ,  H04N7/17318 ,  H04N21/222 ,  H04N21/23406 ,  H04N21/2343 ,  H04N21/23805 ,  H04N21/2402 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6405 ,  H04N21/64322 ,  H04N21/6587 ,  H04N21/8173 ,  H04N21/8545 ,  H04W4/06 ,  H04W28/16 ,  H04W84/12

摘要： A method includes multicasting by a server center of streaming interactive video/audio streams to multiple destinations via an outbound Internet traffic interface. A given video/audio stream is routed to multiple destinations simultaneously. At least one of the video/audio streams is received at a delay buffer of the server center, the delay buffer storing a replayable portion of at least one of the video/audio streams.

公开(公告)号：US08769594B2

公开(公告)日：2014-07-01

申请号：US12359140

申请日：2009-01-23

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/173

CPC分类号： A63F13/30 ,  A63F13/12 ,  A63F13/25 ,  A63F13/335 ,  A63F13/358 ,  A63F13/49 ,  A63F13/77 ,  A63F2300/402 ,  A63F2300/552 ,  H04N7/106 ,  H04N21/2143 ,  H04N21/2385 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/8186

摘要： A system and method are described below for reducing the effects of packet loss in a video communication system. For example, one embodiment of a computer-implemented method comprises: logically subdividing each of a sequence of images of a video stream into a plurality of tiles, each of the tiles having a defined position within each of the sequence of images; and packing the tiles into a plurality of data packets to maximize the number of tiles which are aligned with boundaries of each of the data packets; and transmitting the data packets containing the tiles over a communication channel from a server to a client.

摘要翻译： 下面描述用于减少视频通信系统中的分组丢失的影响的系统和方法。 例如，计算机实现的方法的一个实施例包括：将视频流的图像序列中的每一个逻辑细分为多个瓦片，每个瓦片在每个图像序列内具有定义的位置; 以及将所述瓦片打包成多个数据分组以使与所述数据分组中的每一个的边界对齐的瓦片的数量最大化; 以及通过通信信道从服务器向客户端发送包含瓦片的数据分组。

公开(公告)号：US08661496B2

公开(公告)日：2014-02-25

申请号：US11999474

申请日：2007-12-05

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： A63F9/24 ,  A63F13/00 ,  G06F17/00 ,  G06F19/00 ,  G06F3/00 ,  G06F13/00 ,  H04N5/445 ,  H04N7/18 ,  H04N7/173 ,  H04N7/16

CPC分类号： A63F13/30 ,  A63F13/12 ,  A63F13/335 ,  A63F13/355 ,  A63F13/358 ,  A63F13/525 ,  A63F13/533 ,  A63F13/86 ,  A63F2300/402 ,  A63F2300/552 ,  H04L65/4015 ,  H04L65/604 ,  H04L67/36 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/146 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/174 ,  H04N19/188 ,  H04N19/61 ,  H04N19/66 ,  H04N21/226 ,  H04N21/23805 ,  H04N21/4781 ,  H04N21/6125 ,  H04W28/16 ,  H04W84/12 ,  H04W88/14

摘要： An apparatus comprises a plurality of servers arranged in a parallel processing configuration to create a plurality of streams of low-latency streaming interactive video. Each server produces a stream of low-latency streaming interactive video. A unit combines the plurality of streams into a new stream of low-latency streaming interactive video. The unit is also operable to provide a user interface that allows real-time interactive manipulation of the resulting combined streams by a user.

摘要翻译： 一种装置包括以并行处理配置布置的多个服务器，以创建多个低延迟流式交互式视频流。 每个服务器产生低延迟流交互式视频流。 单元将多个流合并成新的低延迟流交互式视频流。 该单元还可操作以提供允许用户对所得到的组合流进行实时交互式操纵的用户界面。

公开(公告)号：US08632410B2

公开(公告)日：2014-01-21

申请号：US13385330

申请日：2012-02-15

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： A63F13/00

CPC分类号： A63F13/30 ,  A47L13/51 ,  A47L13/59 ,  A63F13/12 ,  A63F13/335 ,  A63F13/355 ,  A63F13/358 ,  A63F13/48 ,  A63F13/52 ,  A63F2300/402 ,  A63F2300/531 ,  A63F2300/535 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/5566 ,  H04N7/106 ,  H04N19/00 ,  H04N19/107 ,  H04N19/132 ,  H04N19/14 ,  H04N19/146 ,  H04N19/154 ,  H04N19/166 ,  H04N19/17 ,  H04N19/176 ,  H04N19/436 ,  H04N19/587 ,  H04N19/59 ,  H04N19/61 ,  H04N19/895 ,  H04N21/23424 ,  H04N21/2343 ,  H04N21/234309 ,  H04N21/234363 ,  H04N21/23805 ,  H04N21/2402 ,  H04N21/27 ,  H04N21/431 ,  H04N21/437 ,  H04N21/472 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/64738 ,  H04N21/64792 ,  H04N21/6587 ,  H04W4/00 ,  H04W28/06

摘要： A method by which a streaming interactive video user session is handed off from one streaming interactive video server to another without noticeable disruption to the video stream or the user interactivity.

摘要翻译： 将流式交互式视频用户会话从一个流式交互式视频服务器切换到另一个流式交互式视频用户会话而不会对视频流或用户交互性产生明显的中断的方法。

公开(公告)号：US08468575B2

公开(公告)日：2013-06-18

申请号：US11999525

申请日：2007-12-05

申请人： Stephen G. Perlman ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Roger van der Laan

IPC分类号： H04N7/173

CPC分类号： A63F13/30 ,  A63F13/12 ,  A63F13/358 ,  A63F2300/402 ,  A63F2300/552 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/115 ,  H04N19/132 ,  H04N19/164 ,  H04N19/172 ,  H04N19/42 ,  H04N19/46 ,  H04N19/61 ,  H04N21/2143 ,  H04N21/2318 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/8186 ,  H04W28/06 ,  H04W84/12 ,  H04W88/14

摘要： A plurality of servers whose video output is coupled to video compression apparatus that transmits streaming interactive video to a plurality of users, with a feedback loop whereby the streaming interactive video is recursively combined within the video output of the plurality of servers.

公开(公告)号：US08013285B2

公开(公告)日：2011-09-06

申请号：US12691500

申请日：2010-01-21

申请人： Stephen G. Perlman ,  Axel Busboom ,  Pamela Greene ,  Tim S. Cotter ,  John Speck ,  Roger van der Laan

发明人： Stephen G. Perlman ,  Axel Busboom ,  Pamela Greene ,  Tim S. Cotter ,  John Speck ,  Roger van der Laan

IPC分类号： H01L27/00 ,  G01T1/161 ,  H01J3/14

CPC分类号： H04N5/357 ,  H04N5/3572

摘要： An apparatus for capturing images. In one embodiment, the apparatus comprises: a coded lens array including a plurality of lenses arranged in a coded pattern and with opaque material blocking array elements that do not contain lenses; and a light-sensitive semiconductor sensor coupled to the coded lens array and positioned at a specified distance behind the coded lens array, the light-sensitive sensor configured to sense light transmitted through the lenses in the coded lens array.

摘要翻译： 用于捕获图像的装置。 在一个实施例中，该装置包括：编码透镜阵列，包括以编码图案排列的多个透镜，并且具有不透明材料阻挡不包含透镜的阵列元件; 以及耦合到所述编码透镜阵列并且位于所述编码透镜阵列之后的特定距离处的感光半导体传感器，所述感光传感器被配置为感测透过所述编码透镜阵列中的透镜的光。

公开(公告)号：US20100167816A1

公开(公告)日：2010-07-01

申请号：US12538041

申请日：2009-08-07

申请人： Stephen G. Perlman ,  Roger Van Der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

发明人： Stephen G. Perlman ,  Roger Van Der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC分类号： A63F13/00 ,  A63F9/24 ,  H04N7/26

CPC分类号： A63F13/30 ,  A63F13/12 ,  A63F13/335 ,  A63F13/355 ,  A63F13/358 ,  A63F13/77 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/535 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/577 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/4307 ,  H04N21/439 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6377 ,  H04N21/6405 ,  H04N21/658 ,  H04N21/6587

摘要： A computer-implemented system and method are described for online gaming. For example, a system according to one embodiment comprises: a video game server receiving user inputs related to an online video game and responsively executing program code of the video game to render a sequence of video images; a first stream encoder to compress the sequence of video images and generate a live video stream during a live gaming session with a user of a client device, the first stream encoder receiving channel feedback signals from the client device and responsively adapting compression of the sequence of video images based on the channel feedback signals, the first stream encoder continually transmitting the live video stream to the client device during the live gaming session with the user; a second stream encoder to compress the sequence of video images at a specified video quality and/or compression ratio unrelated to the channel feedback signal during the live gaming session with the user, thereby generating a High Quality (HQ) video stream, the HQ video stream having a relatively higher video quality and/or lower compression ratio than the live video stream; and a storage device for storing the HQ video stream for subsequent playback to the user of the client device and to other users upon request.

摘要翻译： 描述了用于在线游戏的计算机实现的系统和方法。 例如，根据一个实施例的系统包括：视频游戏服务器，接收与在线视频游戏相关的用户输入并响应地执行视频游戏的程序代码以呈现视频图像序列; 第一流编码器，用于在与客户端设备的用户的实时游戏会话期间压缩视频图像序列并生成实时视频流，所述第一流编码器从客户端设备接收信道反馈信号，并且响应地适应所述序列的序列的压缩 基于信道反馈信号的视频图像，第一流编码器在与用户的实时游戏会话期间，将实时视频流连续地发送到客户端设备; 第二流编码器，用于在与用户的实况游戏会话期间以与信道反馈信号无关的指定视频质量和/或压缩比压缩视频图像序列，从而生成高质量（HQ）视频流，HQ视频 具有比实时视频流更高的视频质量和/或更低的压缩比的流; 以及存储装置，用于根据请求将用于随后重放的HQ视频流存储到客户端设备的用户和其他用户。

公开(公告)号：US20100166063A1

公开(公告)日：2010-07-01

申请号：US12538054

申请日：2009-08-07

申请人： Steve G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

发明人： Steve G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC分类号： H04N11/02

CPC分类号： A63F13/355 ,  A63F13/12 ,  A63F13/25 ,  A63F13/335 ,  A63F13/358 ,  A63F13/71 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/535 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/577 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/234363 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/25833 ,  H04N21/266 ,  H04N21/2662 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587

摘要： A computer-implemented system and method are described for performing video compression. For example, a method according to one embodiment comprises: encoding a plurality of video frames or portions thereof according to a first encoding format; transmitting the plurality of encoded video frames or portions to a client device; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames or portions has not been successfully received and/or decoded; in response to detecting that a video frame or portion thereof has not been successfully received and/or decoded, encoding a video frame or portion thereof according to a second encoding format; and transmitting the video frames or portions thereof to the client device.

摘要翻译： 描述了用于执行视频压缩的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：根据第一编码格式对多个视频帧或其部分进行编码; 将多个编码视频帧或部分发送到客户端设备; 从所述客户端设备接收反馈信息，所述反馈信息可用于确定所述视频帧或部分中包含的数据是否还未被成功接收和/或解码; 响应于检测到视频帧或其部分尚未被成功接收和/或解码，根据第二编码格式对视频帧或其部分进行编码; 并将视频帧或其部分发送到客户端设备。

公开(公告)号：US20100166062A1

公开(公告)日：2010-07-01

申请号：US12538090

申请日：2009-08-07

申请人： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

发明人： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC分类号： H04N7/26 ,  G06K9/36

CPC分类号： H04N19/164 ,  A63F13/12 ,  A63F13/25 ,  A63F13/32 ,  A63F13/355 ,  A63F13/358 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587

摘要： A computer-implemented system and method for performing video compression are described. For example, a method according to one embodiment comprises: encoding a plurality of video frames or portions thereof according to a first encoding format; transmitting the plurality of encoded video frames or portions to a client device; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames or portions has been successfully received and/or decoded; in response to detecting that one or more video frames or portions thereof have not been successfully received and/or decoded, determining a number of video frames or portions thereof which have not been successfully received and/or decoded and: (1) if the number of video frames or portions thereof which have not been successfully received and/or decoded is above a specified threshold, then encoding a new video frame or portion thereof according to a second encoding format, the second encoding format comprising a format which is not dependent on previously-transmitted video frames or portions thereof; or (2) if the number of video frames or portions thereof which have not been successfully received and/or decoded is below a specified threshold, then encoding a new video frame or portion thereof according to the first encoding format, the new video frame encoded to be dependent on a last known successfully received video frame or portion thereof; and transmitting the new video frame or portion thereof to the client device.

摘要翻译： 描述了用于执行视频压缩的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：根据第一编码格式对多个视频帧或其部分进行编码; 将多个编码视频帧或部分发送到客户端设备; 从所述客户端设备接收反馈信息，所述反馈信息可用于确定包含在所述视频帧或部分中的数据是否已被成功接收和/或解码; 响应于检测到一个或多个视频帧或其部分未被成功接收和/或解码，确定尚未成功接收和/或解码的视频帧或其部分的数量，并且：（1）如果该数字 尚未成功接收和/或解码的视频帧或其部分高于规定的阈值，然后根据第二编码格式对新的视频帧或其部分进行编码，第二编码格式包括不依赖于 先前传输的视频帧或其部分; 或（2）如果没有成功接收和/或解码的视频帧或其部分的数量低于指定的阈值，则根据第一编码格式对新的视频帧或其部分进行编码，编码的新的视频帧 取决于最后已知的成功接收的视频帧或其部分; 以及将新的视频帧或其一部分发送到客户端设备。

公开(公告)号：US20100166058A1

公开(公告)日：2010-07-01

申请号：US12538086

申请日：2009-08-07

申请人： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

发明人： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC分类号： H04N7/26

CPC分类号： A63F13/358 ,  A63F13/12 ,  A63F13/335 ,  A63F13/355 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/535 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/577 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/25833 ,  H04N21/25858 ,  H04N21/4263 ,  H04N21/6125 ,  H04N21/6336 ,  H04N21/6377 ,  H04N21/6379 ,  H04N21/64322 ,  H04N21/6547 ,  H04N21/658 ,  H04N21/6587

摘要： A computer-implemented system and method for streaming video from a server to a client are described. For example, a method according to one embodiment comprises: receiving at the server a request for video content from the client; in response to the request, determining the hardware/software configuration of the client; generating and/or selecting a temporary decoder based on the hardware/software configuration of the client; transmitting the temporary decoder to the client, the client installing the temporary decoder; encoding and streaming the requested video content from the server to the client, the video content being encoded based on the capabilities of the temporary decoder, the video content being decoded by the temporary decoder and rendered on the client; detecting that the client has ended the session with the server; and in response to detecting that the client has ended the session, temporarily disabling and/or removing the temporary decoder from the client.

摘要翻译： 描述了用于将视频从服务器流传输到客户端的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：在服务器处接收来自客户端的视频内容的请求; 响应于该请求，确定客户端的硬件/软件配置; 基于客户机的硬件/软件配置生成和/或选择临时解码器; 将临时解码器发送给客户端，客户端安装临时解码器; 编码并将所请求的视频内容从服务器流传输到客户端，视频内容根据临时解码器的能力进行编码，视频内容由临时解码器解码并在客户机上呈现; 检测到客户端已经结束与服务器的会话; 并且响应于检测到客户端已经结束会话，暂时禁用和/或从客户端去除临时解码器。