公开(公告)号：US20160080739A1

公开(公告)日：2016-03-17

申请号：US14951439

申请日：2015-11-24

Applicant: Sony Computer Entertainment America LLC

Inventor： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC: H04N19/107 ,  H04L29/06 ,  H04N19/169 ,  H04N19/61 ,  H04N19/132 ,  H04N19/172

CPC classification number: A63F13/358 ,  A63F13/12 ,  A63F13/355 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/535 ,  A63F2300/538 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04L67/42 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/266 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587

Abstract: A system and method of playing a video game in a streaming mode includes executing a selected video game on an assigned game server, receiving execution control signals corresponding to user inputs to a client device to generate multiple video frames. Encoding the video frames in a shared hardware compression. Some of the encoded video frames depend on a preceding frame. A first and a second encoded video frame are transmitted to the client device. A first feedback signal from a decoder in the client device identifies that the second encoded video frame was not received the decoder. A third encoded video frame dependency is adjusted to produce an adjusted third encoded video frame that depends from the first encoded video frame and the adjusted third encoded video frame is transmitted to the client device.

Abstract translation: 以流式播放视频游戏的系统和方法包括在分配的游戏服务器上执行所选择的视频游戏，将与用户输入相对应的执行控制信号接收到客户端设备以产生多个视频帧。 在共享硬件压缩中对视频帧进行编码。 一些编码视频帧取决于前一帧。 第一和第二编码视频帧被发送到客户端设备。 来自客户端设备中的解码器的第一反馈信号识别出第二编码视频帧未被接收到解码器。 调整第三编码视频帧依赖关系以产生从第一编码视频帧取决于经调整的第三编码视频帧，并将经调整的第三编码视频帧发送到客户端设备。

公开(公告)号：US20160008716A1

公开(公告)日：2016-01-14

申请号：US14862042

申请日：2015-09-22

Applicant: Sony Computer Entertainment America LLC

Inventor： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC: A63F13/35 ,  A63F13/49 ,  A63F13/50

CPC classification number: A63F13/355 ,  A63F13/12 ,  A63F13/33 ,  A63F13/35 ,  A63F13/358 ,  A63F13/49 ,  A63F13/493 ,  A63F13/50 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/552 ,  A63F2300/554 ,  A63F2300/556 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  A63F2300/69 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6377 ,  H04N21/6405 ,  H04N21/658 ,  H04N21/6587

Abstract: A system and method are described for managing the state of an online video game. A method includes initiating a new online video game in response to user input from a client device, the online video game being in a first state on a first server when initiated; executing the online video game on the server, thereby causing the online video game to enter a second state; pausing or terminating the online video game; determining differences between the first state and the second state and generating difference data containing the differences; transmitting the difference data over a network to a second server; and recreating the second state from the difference data and the first state in response to user input indicating that the user wishes to resume the online video game and in response to the second server being selected as the server on which to execute the video game.

Abstract translation: 描述了用于管理在线视频游戏的状态的系统和方法。 一种方法包括：响应于来自客户端设备的用户输入启动新的在线视频游戏，所述在线视频游戏在启动时处于第一服务器上的第一状态; 在服务器上执行在线视频游戏，从而使在线视频游戏进入第二状态; 暂停或终止在线视频游戏; 确定所述第一状态和所述第二状态之间的差异并产生包含所述差异的差分数据; 通过网络将差分数据发送到第二服务器; 以及响应于用户输入指示用户希望恢复在线视频游戏并且响应于第二服务器被选择为执行视频游戏的服务器，从差异数据和第一状态重新创建第二状态。

公开(公告)号：US09420283B2

公开(公告)日：2016-08-16

申请号：US14253357

申请日：2014-04-15

Applicant: Sony Computer Entertainment America LLC

Inventor： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Rob McCool ,  Ian Buckley

IPC: A63F13/12 ,  H04N19/164 ,  A63F13/30 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587 ,  H04L29/06 ,  H04N19/172 ,  H04N19/169 ,  H04N19/61 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/436 ,  H04N7/10

CPC classification number: H04N19/164 ,  A63F13/12 ,  A63F13/25 ,  A63F13/32 ,  A63F13/355 ,  A63F13/358 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587

Abstract: A computer-implemented system and method for performing video compression are described. For example, a method according to one embodiment comprises: encoding a plurality of video frames or portions thereof according to a first encoding format; transmitting the plurality of encoded video frames or portions to a client device; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames or portions has been successfully received and/or decoded; in response to detecting that one or more video frames or portions thereof have not been successfully received and/or decoded, determining a number of video frames or portions thereof which have not been successfully received and/or decoded and: (1) if the number of video frames or portions thereof which have not been successfully received and/or decoded is above a specified threshold, then encoding a new video frame or portion thereof according to a second encoding format, the second encoding format comprising a format which is not dependent on previously-transmitted video frames or portions thereof; or (2) if the number of video frames or portions thereof which have not been successfully received and/or decoded is below a specified threshold, then encoding a new video frame or portion thereof according to the first encoding format, the new video frame encoded to be dependent on a last known successfully received video frame or portion thereof; and transmitting the new video frame or portion thereof to the client device.

Abstract translation: 描述了用于执行视频压缩的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：根据第一编码格式对多个视频帧或其部分进行编码; 将多个编码视频帧或部分发送到客户端设备; 从所述客户端设备接收反馈信息，所述反馈信息可用于确定包含在所述视频帧或部分中的数据是否已被成功接收和/或解码; 响应于检测到一个或多个视频帧或其部分未被成功接收和/或解码，确定尚未成功接收和/或解码的视频帧或其部分的数量，并且：（1）如果该数字 尚未成功接收和/或解码的视频帧或其部分高于规定的阈值，然后根据第二编码格式对新的视频帧或其部分进行编码，第二编码格式包括不依赖于 先前传输的视频帧或其部分; 或（2）如果没有成功接收和/或解码的视频帧或其部分的数量低于指定的阈值，则根据第一编码格式对新的视频帧或其部分进行编码，编码的新的视频帧 取决于最后已知的成功接收的视频帧或其部分; 以及将新的视频帧或其一部分发送到客户端设备。

公开(公告)号：US09308452B2

公开(公告)日：2016-04-12

申请号：US14862042

申请日：2015-09-22

Applicant: Sony Computer Entertainment America LLC

Inventor： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC: A63F13/35 ,  A63F13/50 ,  A63F13/49

CPC classification number: A63F13/355 ,  A63F13/12 ,  A63F13/33 ,  A63F13/35 ,  A63F13/358 ,  A63F13/49 ,  A63F13/493 ,  A63F13/50 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/552 ,  A63F2300/554 ,  A63F2300/556 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  A63F2300/69 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6377 ,  H04N21/6405 ,  H04N21/658 ,  H04N21/6587

Abstract: A system and method are described for managing the state of an online video game. A method includes initiating a new online video game in response to user input from a client device, the online video game being in a first state on a first server when initiated; executing the online video game on the server, thereby causing the online video game to enter a second state; pausing or terminating the online video game; determining differences between the first state and the second state and generating difference data containing the differences; transmitting the difference data over a network to a second server; and recreating the second state from the difference data and the first state in response to user input indicating that the user wishes to resume the online video game and in response to the second server being selected as the server on which to execute the video game.

Abstract translation: 描述了用于管理在线视频游戏的状态的系统和方法。 一种方法包括：响应于来自客户端设备的用户输入启动新的在线视频游戏，所述在线视频游戏在启动时处于第一服务器上的第一状态; 在服务器上执行在线视频游戏，从而使在线视频游戏进入第二状态; 暂停或终止在线视频游戏; 确定所述第一状态和所述第二状态之间的差异并产生包含所述差异的差分数据; 通过网络将差分数据发送到第二服务器; 以及响应于用户输入指示用户希望恢复在线视频游戏并且响应于第二服务器被选择为执行视频游戏的服务器，从差异数据和第一状态重新创建第二状态。

公开(公告)号：US09272220B2

公开(公告)日：2016-03-01

申请号：US14466746

申请日：2014-08-22

Applicant: Sony Computer Entertainment America LLC

Inventor： Douglas Sim Dietrich ,  Nico Benitez ,  Timothy Cotter

IPC: A63F13/53 ,  H04N21/234 ,  H04N21/845 ,  A63F13/355 ,  A63F13/352 ,  G06F1/00

CPC classification number: A63F13/358 ,  A63F13/12 ,  A63F13/352 ,  A63F13/355 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/552 ,  A63F2300/554 ,  A63F2300/556 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  A63F2300/69 ,  G06F1/00 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/164 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/233 ,  H04N21/23406 ,  H04N21/2343 ,  H04N21/235 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6405 ,  H04N21/6587 ,  H04N21/8458

Abstract: An application/game server comprising a central processing unit to process application/video game program code and a graphics processing unit (GPU) to process graphics commands and generate a series of video frames for the application/video game; one or more back buffers to store video frames as the video frames are being created in response to the execution of the graphics commands; a front buffer-outputting the video frame for display one scan line at a time at a designated scan out frequency, a subset of scan lines stored in the front buffer being associated with a vertical blanking interval (VBI); and a frame processing module to begin copying a newly completed frame from the back buffer to the front buffer before the video data for a prior video frame stored in the front buffer has not been fully scanned out.

Abstract translation: 一种应用/游戏服务器，包括处理应用/视频游戏程序代码的中央处理单元和处理图形命令的图形处理单元（GPU），并为应用/视频游戏生成一系列视频帧; 当响应于图形命令的执行正在创建视频帧时存储视频帧的一个或多个后缓冲器; 一个前缓冲器 - 输出用于在指定的扫描频率上一次显示一条扫描线的视频帧，存储在前缓冲器中的与垂直消隐间隔（VBI）相关联的扫描线的子集; 以及帧处理模块，用于在存储在前缓冲器中的先前视频帧的视频数据尚未被完全扫描之前开始将新完成的帧从后缓冲器复制到前缓冲器。

公开(公告)号：US20160007045A1

公开(公告)日：2016-01-07

申请号：US14792329

申请日：2015-07-06

Applicant: Sony Computer Entertainment America LLC

Inventor： Steve Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC: H04N19/65

CPC classification number: A63F13/355 ,  A63F13/12 ,  A63F13/335 ,  A63F13/358 ,  A63F13/77 ,  A63F2300/407 ,  A63F2300/535 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/577 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/164 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N19/65 ,  H04N21/2343 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/266 ,  H04N21/6377 ,  H04N21/658 ,  H04N21/6583 ,  H04N21/6587

Abstract: A computer-implemented system and method are described for performing video compression. For example, a method according to one embodiment comprises: encoding a plurality of video frames or portions thereof according to a first encoding format; transmitting the plurality of encoded video frames or portions to a client device; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames or portions has not been successfully received and/or decoded; in response to detecting that one or more video frames or portions thereof have not been successfully received and/or decoded, then either encoding a new video frame or portion thereof according to a second encoding format or encoding the new video frame to be dependent on the last video frame or portion thereof known to have been successfully received and/or decoded.

Abstract translation: 描述了用于执行视频压缩的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：根据第一编码格式对多个视频帧或其部分进行编码; 将多个编码视频帧或部分发送到客户端设备; 从所述客户端设备接收反馈信息，所述反馈信息可用于确定所述视频帧或部分中包含的数据是否还未被成功接收和/或解码; 响应于检测到一个或多个视频帧或其部分尚未被成功接收和/或解码，则根据第二编码格式对新视频帧或其部分进行编码或编码新视频帧以依赖于 已知已经成功接收和/或解码的最后一个视频帧或其部分。

公开(公告)号：US20150289028A1

公开(公告)日：2015-10-08

申请号：US14746428

申请日：2015-06-22

Applicant: Sony Computer Entertainment America LLC

Inventor： Stephen G. Perlman ,  Roger van der Laan ,  Timothy Cotter ,  Scott Furman ,  Robert McCool ,  Ian Buckley

IPC: H04N21/6336 ,  H04N21/6379 ,  H04N21/643 ,  H04N21/426 ,  H04N21/258

CPC classification number: A63F13/358 ,  A63F13/12 ,  A63F13/335 ,  A63F13/355 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/535 ,  A63F2300/538 ,  A63F2300/552 ,  A63F2300/577 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N7/106 ,  H04N19/107 ,  H04N19/132 ,  H04N19/146 ,  H04N19/169 ,  H04N19/172 ,  H04N19/188 ,  H04N19/436 ,  H04N19/61 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/25833 ,  H04N21/25858 ,  H04N21/4263 ,  H04N21/6125 ,  H04N21/6336 ,  H04N21/6377 ,  H04N21/6379 ,  H04N21/64322 ,  H04N21/6547 ,  H04N21/658 ,  H04N21/6587

Abstract: A computer-implemented system and method for streaming video from a server to a client are described. For example, a method according to one embodiment comprises: receiving at the server a request for video content from the client; in response to the request, determining the hardware/software configuration of the client; generating and/or selecting a temporary decoder based on the hardware/software configuration of the client; transmitting the temporary decoder to the client, the client installing the temporary decoder; encoding and streaming the requested video content from the server to the client, the video content being encoded based on the capabilities of the temporary decoder, the video content being decoded by the temporary decoder and rendered on the client; detecting that the client has ended the session with the server; and in response to detecting that the client has ended the session, temporarily disabling and/or removing the temporary decoder from the client.

Abstract translation: 描述了用于将视频从服务器流传输到客户端的计算机实现的系统和方法。 例如，根据一个实施例的方法包括：在服务器处接收来自客户端的视频内容的请求; 响应于该请求，确定客户端的硬件/软件配置; 基于客户机的硬件/软件配置生成和/或选择临时解码器; 将临时解码器发送给客户端，客户端安装临时解码器; 编码并将所请求的视频内容从服务器流传输到客户端，视频内容根据临时解码器的能力进行编码，视频内容由临时解码器解码并在客户机上呈现; 检测到客户端已经结束与服务器的会话; 并且响应于检测到客户端已经结束会话，暂时禁用和/或从客户端去除临时解码器。

公开(公告)号：US20160303479A1

公开(公告)日：2016-10-20

申请号：US15194514

申请日：2016-06-27

Applicant: Sony Computer Entertainment America LLC

Inventor： Timothy Cotter

IPC: A63F13/355 ,  A63F13/352

CPC classification number: A63F13/355 ,  A63F13/12 ,  A63F13/335 ,  A63F13/352 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/552 ,  A63F2300/554 ,  A63F2300/556 ,  A63F2300/5593 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  A63F2300/69 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N21/233 ,  H04N21/23406 ,  H04N21/2343 ,  H04N21/235 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6405 ,  H04N21/6587 ,  H04N21/8458

Abstract: A method includes the following operations: (1) executing an application that that generates a series of video frames using a graphics processing unit (GPU); (2) determining that a first video frame in the series has been completely written to a back buffer; (3) determining whether a current scan line of a second video frame is outside of a specified region, where the second video frame is stored in a front buffer and is being read out line by line following receipt of a monitored synchronizing signal; (4) presenting the first video frame to the front buffer without frame transitions, if the current scan line is outside of the specified region and is in a vertical blanking interval (VBI); and (5) presenting the first video to the front buffer with frame transitions, if the current scan line is outside of the specified region and is not in the VBI.

Abstract translation: 一种方法包括以下操作：（1）使用图形处理单元（GPU）执行生成一系列视频帧的应用程序; （2）确定该系列中的第一视频帧已被完全写入后缓冲器; （3）确定第二视频帧的当前扫描线是否在指定区域之外，其中第二视频帧存储在前缓冲器中，并且在接收到所监视的同步信号之后逐行地读出; （4）如果当前扫描线在指定区域之外并处于垂直消隐间隔（VBI），则将第一视频帧呈现到前缓冲器而没有帧转换; 如果当前扫描线在指定区域之外并且不在VBI中，则（5）将第一视频呈现到具有帧转换的前缓冲器。

公开(公告)号：US09375635B2

公开(公告)日：2016-06-28

申请号：US13789621

申请日：2013-03-07

Applicant: Sony Computer Entertainment America LLC

Inventor： Timothy Cotter

IPC: A63F13/12 ,  G06T15/00 ,  A63F13/00 ,  A63F13/30 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/235 ,  H04N21/2381 ,  H04N21/478 ,  H04N21/61 ,  H04N21/6587 ,  H04N21/845 ,  H04L29/06 ,  H04N21/234 ,  H04N21/6405

CPC classification number: A63F13/355 ,  A63F13/12 ,  A63F13/335 ,  A63F13/352 ,  A63F2300/402 ,  A63F2300/407 ,  A63F2300/534 ,  A63F2300/552 ,  A63F2300/554 ,  A63F2300/556 ,  A63F2300/5593 ,  A63F2300/572 ,  A63F2300/577 ,  A63F2300/636 ,  A63F2300/69 ,  H04L65/403 ,  H04L65/4076 ,  H04L65/605 ,  H04L67/38 ,  H04N21/233 ,  H04N21/23406 ,  H04N21/2343 ,  H04N21/235 ,  H04N21/2381 ,  H04N21/4781 ,  H04N21/6125 ,  H04N21/6405 ,  H04N21/6587 ,  H04N21/8458

Abstract: A system and method for efficiently performing graphics operations on a video game/application hosting service. One embodiment of a system comprises: an application/game server comprising a central processing unit and a graphics processing unit generating a series of video frames; a buffer management logic to manage the series of video frames; a shared buffer managed by the buffer management logic to store the video frames generated; wherein the buffer management logic continually monitors a signal indicating when a video display or video compression unit is ready to receive a next video frame and, responsive to detecting that the display or video compression unit is about to be ready, the buffer management logic to transfer the most recently completed from the shared buffer to a back buffer; and responsive to detecting the signal, the buffer management logic transferring the video frame from the back buffer to a front buffer.

Abstract translation: 一种用于在视频游戏/应用托管服务上有效执行图形操作的系统和方法。 系统的一个实施例包括：应用/游戏服务器，包括中央处理单元和产生一系列视频帧的图形处理单元; 用于管理一系列视频帧的缓冲器管理逻辑; 由缓冲管理逻辑管理的共享缓冲存储生成的视频帧; 其中所述缓冲器管理逻辑连续地监视指示视频显示或视频压缩单元何时准备好接收下一视频帧的信号，并且响应于检测到所述显示或视频压缩单元即将准备就绪，所述缓冲器管理逻辑被传送 最近从共享缓冲区完成到后台缓冲区; 并且响应于检测到所述信号，所述缓冲器管理逻辑将所述视频帧从所述后缓冲器传送到前缓冲器。