公开(公告)号：US10469873B2

公开(公告)日：2019-11-05

申请号：US15730096

申请日：2017-10-11

Applicant: Google LLC

Inventor： Derek Pang ,  Colvin Pitts ,  Kurt Akeley ,  Zeyar Htet

IPC: H04N19/597 ,  H04N19/44 ,  H04N19/162 ,  H04N19/436 ,  H04N19/186 ,  H04N19/176 ,  H04N5/222 ,  H04N5/225 ,  H04N5/247 ,  H04N13/243 ,  H04N13/194 ,  H04N13/232 ,  H04N13/282 ,  H04N13/156 ,  H04N13/117 ,  H04N13/161 ,  H04N19/93 ,  H04N19/91 ,  H04N13/366 ,  H04N13/344 ,  H04N13/275

Abstract: A virtual reality or augmented reality experience of a scene may be decoded for playback for a viewer through a combination of CPU and GPU processing. A video stream may be retrieved from a data store. A first viewer position and/or orientation may be received from an input device, such as the sensor package on a head-mounted display (HMD). At a processor, the video stream may be partially decoded to generate a partially-decoded bitstream. At a graphics processor, the partially-decoded bitstream may be further decoded to generate viewpoint video of the scene from a first virtual viewpoint corresponding to the first viewer position and/or orientation. The viewpoint video may be displayed on a display device, such as screen of the HMD.