公开(公告)号：US10341632B2

公开(公告)日：2019-07-02

申请号：US15590877

申请日：2017-05-09

Applicant: Google LLC.

Inventor： Derek Pang ,  Colvin Pitts ,  Kurt Akeley

IPC: G06F3/00 ,  G06F3/01 ,  G06F3/03 ,  H04N5/222 ,  H04N5/225 ,  H04N5/247 ,  H04N13/117 ,  H04N13/156 ,  H04N13/161 ,  H04N13/194 ,  H04N13/232 ,  H04N13/243 ,  H04N13/275 ,  H04N13/282 ,  H04N13/344

Abstract: An environment may be displayed from a viewpoint. According to one method, volumetric video data may be acquired depicting the environment, for example, using a tiled camera array. A plurality of vantages may be distributed throughout a viewing volume from which the environment is to be viewed. The volumetric video data may be used to generate video data for each vantage, representing the view of the environment from that vantage. User input may be received designating a viewpoint within the viewing volume. From among the plurality of vantages, a subset nearest to the viewpoint may be identified. The video data from the subset may be retrieved and combined to generate viewpoint video data depicting the environment from the viewpoint. The viewpoint video data may be displayed for the viewer to display a view of the environment from the viewpoint selected by the user.

公开(公告)号：US10546424B2

公开(公告)日：2020-01-28

申请号：US15729918

申请日：2017-10-11

Applicant: GOOGLE LLC

Inventor： Derek Pang ,  Colvin Pitts ,  Kurt Akeley

IPC: G06T19/00 ,  G06F3/01 ,  H04N13/117 ,  H04N13/139

Abstract: A virtual reality or augmented reality experience of a scene may be presented to a viewer using layered data retrieval and/or processing. A first layer of a video stream may be retrieved, and a first viewer position and/or orientation may be received. The first layer may be processed to generate first viewpoint video of the scene from a first virtual viewpoint corresponding to the first viewer position and/or orientation. The first viewpoint video may be displayed for the viewer. Then, a second layer of the video stream may be retrieved, and a second viewer position and/or orientation may be received. The second layer may be processed to generate second viewpoint video of the scene from a second virtual viewpoint corresponding to the second viewer position and/or orientation, with higher quality than the first viewpoint video. The second viewpoint video may be displayed for the viewer.

公开(公告)号：US10419737B2

公开(公告)日：2019-09-17

申请号：US15706343

申请日：2017-09-15

Applicant: GOOGLE LLC

Inventor： Derek Pang ,  Colvin Pitts ,  Kurt Akeley

IPC: H04N13/117 ,  H04N13/156 ,  H04N13/161 ,  H04N13/243 ,  H04N13/282 ,  H04N13/344 ,  H04N5/222 ,  H04N5/225 ,  H04N5/247 ,  H04N19/597 ,  H04N13/232 ,  H04N19/46 ,  H04N19/42 ,  H04N19/33 ,  H04N13/275 ,  H04N19/147 ,  H04N19/436 ,  H04N19/895

Abstract: A video stream for a scene for a virtual reality or augmented reality experience may be stored and delivered to a viewer. The video stream may be divided into a plurality of units based on time segmentation, viewpoint segmentation, and/or view orientation segmentation. Each of the units may be divided into a plurality of sub-units based on a different segmentation from the units, via time segmentation, viewpoint segmentation, and/or view orientation segmentation. At least a portion of the video stream may be stored in a file that includes a plurality of the units. Each unit may be a group of pictures that is a sequence of successive frames in time. Each sub-unit may be a vantage defining a viewpoint from which the scene is viewable. Each vantage may be further divided into tiles, each of which is part of the vantage, limited to one or more particular view orientations.

公开(公告)号：US10298834B2

公开(公告)日：2019-05-21

申请号：US15207110

申请日：2016-07-11

Applicant: GOOGLE LLC

Inventor： Colvin Pitts ,  Yi-Ren Ng

IPC: G06T5/50 ,  G06T5/00 ,  H01L27/146 ,  G02B27/00 ,  H04N5/232 ,  H04N13/207 ,  G06T5/20

Abstract: A video refocusing system operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.

公开(公告)号：US11849257B2

公开(公告)日：2023-12-19

申请号：US17394321

申请日：2021-08-04

Applicant: Google LLC

Inventor： Colvin Pitts ,  Aaron Michael Donsbach

IPC: H04N7/15 ,  H04L12/18 ,  H04N7/14 ,  H04L9/40

CPC classification number: H04N7/157 ,  H04L12/1818 ,  H04L12/1822 ,  H04L63/101 ,  H04N7/147 ,  H04N7/152

Abstract: Systems and methods for multi-attendee video conferencing are described. A system can convert from huddle video conference mode to spatial video conference mode. In particular, by assigning user roles, specific users can have greater control of the video conference as compared to other users. For instance, moderators may have a greater level of control of the video conferencing system. Thus, in example implementations of the present disclosure, specific users can affect transition between two or more video conferencing modes, such as between a huddle video conference mode and a spatial video conference mode.

公开(公告)号：US20230044865A1

公开(公告)日：2023-02-09

申请号：US17394324

申请日：2021-08-04

Applicant: Google LLC

Inventor： Colvin Pitts ,  Aaron Michael Donsbach

IPC: H04N7/15 ,  H04N7/14 ,  H04L29/06 ,  H04L12/18 ,  H04M3/56

Abstract: Systems and methods for multi-attendee video conferencing are described. A system can convert from huddle video conference mode to spatial video conference mode. In particular, by assigning user roles, specific users can have greater control of the video conference as compared to other users. For instance, moderators may have a greater level of control of the video conferencing system. Thus, in example implementations of the present disclosure, specific users can affect transition between two or more video conferencing modes, such as between a huddle video conference mode and a spatial video conference mode.

公开(公告)号：US20220198605A1

公开(公告)日：2022-06-23

申请号：US17437576

申请日：2019-03-10

Applicant: Google LLC

Inventor： Colvin Pitts

IPC: G06T3/40 ,  G06T3/00 ,  G06T5/50

Abstract: Devices and methods related to capturing 360 degree spherical images are provided. A computing device can capture, substantially simultaneously, a first image with the first image sensor and a second image with a second image sensor. The first image sensor can be positioned on a first side of the computing device and oriented at a first orientation with respect to an axis of rotation. The second image sensor can be positioned on a second side of the device substantially opposite the first side of the device and oriented at a second orientation that is axially rotated from the first orientation with respect to the axis of rotation. The computing device can stitch together the first image and the second image to create an output image that captures a 360 degree field of view with respect to the computing device.

公开(公告)号：US10897608B2

公开(公告)日：2021-01-19

申请号：US16032261

申请日：2018-07-11

Applicant: Google LLC

Inventor： Colvin Pitts ,  Chia-Kai Liang ,  Kurt Akeley

IPC: H04N13/229 ,  G02B3/00 ,  H04N13/218 ,  H04N13/232

Abstract: A light-field camera may generate four-dimensional light-field data indicative of incoming light. The light-field camera may have an aperture configured to receive the incoming light, an image sensor, and a microlens array configured to redirect the incoming light at the image sensor. The image sensor may receive the incoming light and, based on the incoming light, generate the four-dimensional light-field data, which may have first and second spatial dimensions and first and second angular dimensions. The first angular dimension may have a first resolution higher than a second resolution of the second angular dimension.

公开(公告)号：US10412373B2

公开(公告)日：2019-09-10

申请号：US15582237

申请日：2017-04-28

Applicant: GOOGLE LLC

Inventor： Colvin Pitts

IPC: H04N13/00 ,  H04N13/282 ,  H04N13/111 ,  H04N13/243 ,  H04N13/275 ,  H04N13/388 ,  G06T15/20 ,  H04N5/225 ,  H04N13/232 ,  H04N13/117 ,  H04N13/25 ,  H04N13/344

Abstract: A light-field camera system such as a tiled camera array may be used to capture a light-field of an environment. The tiled camera array may be a tiered camera array with a first plurality of cameras and a second plurality of cameras that are arranged more densely, but have lower resolution, than those of the first plurality of cameras. The first plurality of cameras may be interspersed among the second plurality of cameras. The first and second pluralities may cooperate to capture the light-field. According to one method, a subview may be captured by each camera of the first and second pluralities. Estimated world properties of the environment may be computed for each subview. A confidence map may be generated to indicate a level of confidence in the estimated world properties for each subview. The confidence maps and subviews may be used to generate a virtual view of the environment.

公开(公告)号：US11637991B2

公开(公告)日：2023-04-25

申请号：US17394324

申请日：2021-08-04

Applicant: Google LLC

Inventor： Colvin Pitts ,  Aaron Michael Donsbach

IPC: H04N7/15 ,  H04N7/14 ,  H04M3/56 ,  H04L12/18 ,  H04L9/40

Abstract: Systems and methods for multi-attendee video conferencing are described. A system can convert from huddle video conference mode to spatial video conference mode. In particular, by assigning user roles, specific users can have greater control of the video conference as compared to other users. For instance, moderators may have a greater level of control of the video conferencing system. Thus, in example implementations of the present disclosure, specific users can affect transition between two or more video conferencing modes, such as between a huddle video conference mode and a spatial video conference mode.