-
公开(公告)号:US20170246544A1
公开(公告)日:2017-08-31
申请号:US15055509
申请日:2016-02-26
Applicant: Microsoft Technology Licensing, LLC
Inventor: Sharad Agarwal , Stefan Saroiu , Alastair Wolman , Lenin Ravindranath Sivalingam , Eduardo Cuervo , Paramvir Bahl , Petko Ivanov Georgiev
IPC: A63F13/86 , A63F13/537 , A63F13/63 , A63F13/35
CPC classification number: A63F13/86 , A63F13/35 , A63F13/5375 , A63F13/63
Abstract: A system is provided that allows a spectator to spectate video gameplay over a network. Recorded information associated with a selected recording of a player playing a video game that includes a game engine is received over the network. The recorded information includes game commands that were input to the game engine as the player was playing the game, and inputs the player made to the game to control it. The recorded information is replayed to the game at the timing in which this information was originally recorded, where this replay includes replaying the game commands to the game engine. The replay generates a playback of the selected recording which is displayed on the display screen of the spectator's computer. Upon receiving a request from the spectator to view the inputs the player made to the game they are highlighted on the screen during the playback of the selected recording.
-
公开(公告)号:US09965823B2
公开(公告)日:2018-05-08
申请号:US14630830
申请日:2015-02-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Kiryong Ha , Paramvir Bahl , David Chiyuan Chu , Eduardo Cuervo , Lenin Ravindranath Sivalingam , Alastair Wolman
CPC classification number: G06T1/20 , G06F9/455 , G06F9/45558 , G06F9/48 , G06F2009/4557
Abstract: The claimed subject matter includes techniques for live migration of a graphics processing unit (GPU) state. An example method includes receiving recorded GPU commands from a relay at a destination GPU. The method also includes replaying the recorded GPU commands at the destination GPU. The method also includes detecting a downtime for the GPU commands. The method further includes establishing a connection between the destination GPU and the client during the detected downtime.
-
公开(公告)号:US11109011B2
公开(公告)日:2021-08-31
申请号:US16731693
申请日:2019-12-31
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eric Horvitz , Eduardo Cuervo , David Chu
IPC: H04N13/00 , H04N13/139 , H04N21/2343 , H04N21/24 , H04N21/81 , H04N21/4402 , H04N13/117 , H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383 , H04N13/106
Abstract: A server may be configured to receive first pose data from a virtual reality device, generate second pose data, including a pose prediction, based at least on the first pose data, render a map representation based at least on the pose prediction, determine regions of the map representation based on a likelihood of view of each of the regions, perform foveation in each of the regions and generate an encoded frame based on the regions and a network parameter, and send the encoded frame and second pose data to the device. The encoding may associate each of the regions with a quality level and base the foveation on each region's associated quality level. The foveation may use different quantization parameters for each of the regions and/or use rendering foveation for each of regions. Network conditions such as latency, bandwidth, and/or jitter may be considered for bit allocation in the foveation.
-
公开(公告)号:US20190155372A1
公开(公告)日:2019-05-23
申请号:US15817007
申请日:2017-11-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eduardo Cuervo , Monia Ghobadi , Krishna Chintalapudi , Manikanta Kotaru
Abstract: A virtual reality system including a head mounted display (HMD), a server, and a beam steering apparatus utilizes optical data transmission from the server to the HMD. The data rates/bandwidths provided by optical data transmission allow the amount of compression needed for data transfer (and the latency associated with compression) to the HMD to be reduced. The efficient offloading of processing tasks from the HMD to the server, reduces HMD power consumption, and enables the delivery of video having high resolution, framerate, and quality. As the user of the HMD moves, and the pose (position and orientation) of the HMD changes, the pose is provided to the server and beam steering apparatus. Based on the pose, the server renders image frames for transmission to the HMD and the beam steering apparatus directs an optical beam to the HMD to enable transmission of the image frames from the server to the HMD.
-
公开(公告)号:US20160247248A1
公开(公告)日:2016-08-25
申请号:US14630830
申请日:2015-02-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Kiryong Ha , Paramvir Bahl , David Chiyuan Chu , Eduardo Cuervo , Lenin Ravindranath Sivalingam , Alastair Wolman
IPC: G06T1/20
CPC classification number: G06T1/20 , G06F9/455 , G06F9/45558 , G06F9/48 , G06F2009/4557
Abstract: The claimed subject matter includes techniques for live migration of a graphics processing unit (GPU) state. An example method includes receiving recorded GPU commands from a relay at a destination GPU. The method also includes replaying the recorded GPU commands at the destination GPU. The method also includes detecting a downtime for the GPU commands. The method further includes establishing a connection between the destination GPU and the client during the detected downtime.
Abstract translation: 所要求保护的主题包括用于图形处理单元(GPU)状态的实时迁移的技术。 示例性方法包括从目的地GPU的中继器接收记录的GPU命令。 该方法还包括在目标GPU处重放记录的GPU命令。 该方法还包括检测GPU命令的停机时间。 该方法还包括在检测到的停机期间建立目的地GPU与客户端之间的连接。
-
公开(公告)号:US10509463B2
公开(公告)日:2019-12-17
申请号:US15817007
申请日:2017-11-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eduardo Cuervo , Monia Ghobadi , Krishna Chintalapudi , Manikanta Kotaru
Abstract: A virtual reality system including a head mounted display (HMD), a server, and a beam steering apparatus utilizes optical data transmission from the server to the HMD. The data rates/bandwidths provided by optical data transmission allow the amount of compression needed for data transfer (and the latency associated with compression) to the HMD to be reduced. The efficient offloading of processing tasks from the HMD to the server, reduces HMD power consumption, and enables the delivery of video having high resolution, framerate, and quality. As the user of the HMD moves, and the pose (position and orientation) of the HMD changes, the pose is provided to the server and beam steering apparatus. Based on the pose, the server renders image frames for transmission to the HMD and the beam steering apparatus directs an optical beam to the HMD to enable transmission of the image frames from the server to the HMD.
-
公开(公告)号:US10204395B2
公开(公告)日:2019-02-12
申请号:US15298158
申请日:2016-10-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eduardo Cuervo , Kevin Boos , David Chu
Abstract: Virtual reality is provided by a mobile VR device. VR scenes are displayed by serving an application's image requests from a local cache of pre-rendered image frames. As the device user moves, image frames that match a VR scene viewed from a current pose (3D position and 3D orientation of the device translated to the virtual environment) are retrieved from the cache and displayed to the user as a VR scene. The cache may include a static cache including static image frames and a dynamic object cache including dynamic object image frames. The static cache may be indexed by the device current pose. The dynamic object cache may be indexed by the dynamic object's animation stage, orientation, and relative distance from the device user's current pose for a given time or movement-based trigger. Static image frames and dynamic object image frames may be composited, and displayed as a scene.
-
公开(公告)号:US20180220119A1
公开(公告)日:2018-08-02
申请号:US15622836
申请日:2017-06-14
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eric Horvitz , Eduardo Cuervo , David Chu
IPC: H04N13/00 , H04N13/04 , H04N21/2343 , H04N21/24 , H04N21/81 , H04N21/4402
CPC classification number: H04N13/139 , H04N13/106 , H04N13/117 , H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383 , H04N21/234345 , H04N21/234363 , H04N21/2402 , H04N21/440245 , H04N21/816
Abstract: A server may be configured to receive first pose data from a virtual reality device, generate second pose data, including a pose prediction, based at least on the first pose data, render a map representation based at least on the pose prediction, determine regions of the map representation based on a likelihood of view of each of the regions, perform foveation in each of the regions and generate an encoded frame based on the regions and a network parameter, and send the encoded frame and second pose data to the device. The encoding may associate each of the regions with a quality level and base the foveation on each region's associated quality level. The foveation may use different quantization parameters for each of the regions and/or use rendering foveation for each of regions. Network conditions such as latency, bandwidth, and/or jitter may be considered for bit allocation in the foveation.
-
公开(公告)号:US20200169716A1
公开(公告)日:2020-05-28
申请号:US16731693
申请日:2019-12-31
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eric Horvitz , Eduardo Cuervo , David Chu
IPC: H04N13/139 , H04N21/2343 , H04N21/24 , H04N21/81 , H04N21/4402 , H04N13/117 , H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383 , H04N13/106
Abstract: A server may be configured to receive first pose data from a virtual reality device, generate second pose data, including a pose prediction, based at least on the first pose data, render a map representation based at least on the pose prediction, determine regions of the map representation based on a likelihood of view of each of the regions, perform foveation in each of the regions and generate an encoded frame based on the regions and a network parameter, and send the encoded frame and second pose data to the device. The encoding may associate each of the regions with a quality level and base the foveation on each region's associated quality level. The foveation may use different quantization parameters for each of the regions and/or use rendering foveation for each of regions. Network conditions such as latency, bandwidth, and/or jitter may be considered for bit allocation in the foveation.
-
公开(公告)号:US10560680B2
公开(公告)日:2020-02-11
申请号:US15622836
申请日:2017-06-14
Applicant: Microsoft Technology Licensing, LLC
Inventor: Eric Horvitz , Eduardo Cuervo , David Chu
IPC: H04N13/00 , H04N13/139 , H04N21/2343 , H04N21/24 , H04N21/81 , H04N21/4402 , H04N13/117 , H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383
Abstract: A server may be configured to receive first pose data from a virtual reality device, generate second pose data, including a pose prediction, based at least on the first pose data, render a map representation based at least on the pose prediction, determine regions of the map representation based on a likelihood of view of each of the regions, perform foveation in each of the regions and generate an encoded frame based on the regions and a network parameter, and send the encoded frame and second pose data to the device. The encoding may associate each of the regions with a quality level and base the foveation on each region's associated quality level. The foveation may use different quantization parameters for each of the regions and/or use rendering foveation for each of regions. Network conditions such as latency, bandwidth, and/or jitter may be considered for bit allocation in the foveation.
-
-
-
-
-
-
-
-
-