公开(公告)号：US20180061119A1

公开(公告)日：2018-03-01

申请号：US15246040

申请日：2016-08-24

Applicant: Google Inc.

Inventor： Matthew Milton Pharr ,  Manfred Ernst ,  Puneet Lall

IPC: G06T15/20 ,  G06T15/04 ,  G06T15/00

CPC classification number: G06T15/205 ,  G06T15/005 ,  G06T15/04

Abstract: In one general aspect, a computer-implemented method can include identifying a plurality of pixel samples included in a layered depth image (LDI) representation of a scene for rendering in a three-dimensional (3D) image in a virtual reality (VR) space, grouping, by a processor, a subset of the plurality of pixel samples into a block of data, including extracting each pixel sample included in the subset of the plurality of pixel samples from the LDI representation of the scene for inclusion in the block of data based on an error metric associated with the respective pixel sample, creating, by the processor, a texture map for a block of data, the texture map being associated with the block of data, storing the block of data and the texture map, and triggering a rendering of the 3D image in the VR space using the block of data and the texture map.

公开(公告)号：US10325403B2

公开(公告)日：2019-06-18

申请号：US15246040

申请日：2016-08-24

Applicant: Google Inc.

Inventor： Matthew Milton Pharr ,  Manfred Ernst ,  Puneet Lall

IPC: G06T15/20 ,  G06T15/00 ,  G06T15/04

Abstract: In one general aspect, a computer-implemented method can include identifying a plurality of pixel samples included in a layered depth image (LDI) representation of a scene for rendering in a three-dimensional (3D) image in a virtual reality (VR) space, grouping, by a processor, a subset of the plurality of pixel samples into a block of data, including extracting each pixel sample included in the subset of the plurality of pixel samples from the LDI representation of the scene for inclusion in the block of data based on an error metric associated with the respective pixel sample, creating, by the processor, a texture map for a block of data, the texture map being associated with the block of data, storing the block of data and the texture map, and triggering a rendering of the 3D image in the VR space using the block of data and the texture map.

公开(公告)号：US20170178395A1

公开(公告)日：2017-06-22

申请号：US15380948

申请日：2016-12-15

Applicant: Google Inc.

Inventor： Matthew Milton Pharr

IPC: G06T15/50 ,  G06T15/04 ,  G06T19/00 ,  G06T11/60

CPC classification number: G06T15/503 ,  G06T11/60 ,  G06T15/205 ,  G06T2200/21 ,  H04N13/111 ,  H04N13/344 ,  H04N2013/0088

Abstract: Systems and methods are described include generating, using light field rendering based on a plurality of collected images, a rendered image that uses a variable computational complexity to generate a plurality of pixels of the rendered image based on a location of the pixel. The generating may include determining each pixel of a first set of pixels for the rendered image based on a blending, using a first blending technique, of one or more pixels of a first resolution mipmap image for each of the plurality of collected images, and determining each pixel of a second set of pixels for the rendered image based on a blending, using a second blending technique, of one or more pixels of a second resolution mipmap image for each of the plurality of collected images, wherein the second resolution mipmap images are lower resolution than the first resolution mipmap images.

公开(公告)号：US20170180721A1

公开(公告)日：2017-06-22

申请号：US15271813

申请日：2016-09-21

Applicant: Google Inc.

Inventor： Evan Hardesty Parker ,  Matthew Milton Pharr ,  Johnny Chung Lee ,  Craig Donner ,  Daniel Erickson ,  Dominik Philemon Kaeser

IPC: H04N13/04 ,  G06F3/01

Abstract: In a system having a user-portable display device, a method includes maintaining a lightfield data structure representing at least a portion of a four-dimensional (4D) lightfield for a three-dimensional (3D) world in association with a first pose of the user-portable display device relative to the 3D world. The method further includes determining a second pose of the user-portable display device relative to the 3D world, the second pose comprising an updated pose of the user-portable display device. The method additionally includes generating a display frame from the lightfield data structure based on the second pose, the display frame representing a field of view of the 3D world from the second pose.