VANTAGE GENERATION AND INTERACTIVE PLAYBACK
    1.
    发明申请

    公开(公告)号:US20180329602A1

    公开(公告)日:2018-11-15

    申请号:US15590841

    申请日:2017-05-09

    申请人: Lytro, Inc.

    发明人: Kurt Akeley

    摘要: Video data of an environment may be prepared for presentation to a user in a virtual reality or augmented reality experience. According to one method, a plurality of locations distributed throughout a viewing volume may be designated, at which a plurality of vantages are to be positioned to facilitate viewing of the environment from proximate the locations. For each location, a plurality of images of the environment, captured from viewpoints proximate the location, may be retrieved. For each location, the images may be reprojected to a three-dimensional shape and combined to generate a combined image. The combined image may be applied to one or more surfaces of the three-dimensional shape to generate a vantage. The vantages may be stored such that the vantages can be used to generate viewpoint video of the scene, as viewed from a virtual viewpoint corresponding to an actual viewer's viewpoint within the viewing volume.

    STEREO IMAGE GENERATION AND INTERACTIVE PLAYBACK

    公开(公告)号:US20180033209A1

    公开(公告)日:2018-02-01

    申请号:US15730481

    申请日:2017-10-11

    申请人: Lytro, Inc.

    发明人: Kurt Akeley

    IPC分类号: G06T19/00 H04N13/00 G06T19/20

    摘要: Video data of an environment may be prepared for stereoscopic presentation to a user in a virtual reality or augmented reality experience. According to one method, a plurality of locations distributed throughout a viewing volume may be designated, at which a plurality of vantages are to be positioned to facilitate viewing of the environment from proximate the locations. For each location, a plurality of images of the environment, captured from viewpoints proximate the location, may be retrieved. For each location, the images may be reprojected to a three-dimensional shape and combined to generate a combined image. The combined image may be applied to one or more surfaces of the three-dimensional shape to generate a vantage. The vantages may be stored such that the vantages can be used to generate stereoscopic viewpoint video of the scene, as viewed from at least two virtual viewpoints corresponding to viewpoints of an actual viewer's eyes within the viewing volume.

    DATA STRUCTURES AND DELIVERY METHODS FOR EXPEDITING VIRTUAL REALITY PLAYBACK

    公开(公告)号:US20180020204A1

    公开(公告)日:2018-01-18

    申请号:US15706343

    申请日:2017-09-15

    申请人: Lytro, Inc.

    IPC分类号: H04N13/00 H04N13/02 H04N13/04

    摘要: A video stream for a scene for a virtual reality or augmented reality experience may be stored and delivered to a viewer. The video stream may be divided into a plurality of units based on time segmentation, viewpoint segmentation, and/or view orientation segmentation. Each of the units may be divided into a plurality of sub-units based on a different segmentation from the units, via time segmentation, viewpoint segmentation, and/or view orientation segmentation. At least a portion of the video stream may be stored in a file that includes a plurality of the units. Each unit may be a group of pictures that is a sequence of successive frames in time. Each sub-unit may be a vantage defining a viewpoint from which the scene is viewable. Each vantage may be further divided into tiles, each of which is part of the vantage, limited to one or more particular view orientations.

    Compression of Light Field Images
    6.
    发明申请
    Compression of Light Field Images 审中-公开
    压缩光场图像

    公开(公告)号:US20160316218A1

    公开(公告)日:2016-10-27

    申请号:US15203683

    申请日:2016-07-06

    申请人: Lytro Inc.

    摘要: RAW images and/or light field images may be compressed through the use of specialized techniques. The color depth of a light field image may be reduced through the use of a bit reduction algorithm such as a K-means algorithm. The image may then be retiled to group pixels of similar intensities and/or colors. The retiled image may be padded with extra pixel rows and/or pixel columns as needed, and compressed through the use of an image compression algorithm. The compressed image may be assembled with metadata pertinent to the manner in which compression was done to form a compressed image file. The compressed image file may be decompressed by following the compression method in reverse.

    摘要翻译: 可以通过使用专门的技术来压缩RAW图像和/或光场图像。 可以通过使用诸如K-means算法的比特缩减算法来减少光场图像的颜色深度。 然后可以将图像定位成对类似强度和/或颜色的像素进行分组。 根据需要,可以用额外的像素行和/或像素列填充被覆盖的图像,并且通过使用图像压缩算法进行压缩。 可以使用与进行压缩以形成压缩图像文件的方式相关的元数据来组合压缩图像。 压缩图像文件可以通过相反的压缩方法来解压缩。

    Compression of light field images
    7.
    发明授权
    Compression of light field images 有权
    压缩光场图像

    公开(公告)号:US09414087B2

    公开(公告)日:2016-08-09

    申请号:US14261144

    申请日:2014-04-24

    申请人: Lytro, Inc.

    摘要: RAW images and/or light field images may be compressed through the use of specialized techniques. The color depth of a light field image may be reduced through the use of a bit reduction algorithm such as a K-means algorithm. The image may then be retiled to group pixels of similar intensities and/or colors. The retiled image may be padded with extra pixel rows and/or pixel columns as needed, and compressed through the use of an image compression algorithm. The compressed image may be assembled with metadata pertinent to the manner in which compression was done to form a compressed image file. The compressed image file may be decompressed by following the compression method in reverse.

    摘要翻译: 可以通过使用专门的技术来压缩RAW图像和/或光场图像。 可以通过使用诸如K-means算法的比特缩减算法来减少光场图像的颜色深度。 然后可以将图像定位成对类似强度和/或颜色的像素进行分组。 根据需要,可以用额外的像素行和/或像素列填充被覆盖的图像,并且通过使用图像压缩算法进行压缩。 可以使用与进行压缩以形成压缩图像文件的方式相关的元数据来组合压缩图像。 压缩图像文件可以通过相反的压缩方法来解压缩。

    High-quality post-rendering depth blur
    8.
    发明授权
    High-quality post-rendering depth blur 有权
    高品质的后渲染深度模糊

    公开(公告)号:US09305375B2

    公开(公告)日:2016-04-05

    申请号:US14224763

    申请日:2014-03-25

    申请人: Lytro, Inc.

    发明人: Kurt Akeley

    摘要: The present invention may provide techniques for blurring an image. The image may be a light field image with color values and depth values for each pixel. The method may include retrieving the image and calculating a blurred color value of a subject pixel of the image. Calculating the blurred color value may include calculating first and second circles of confusion proximate coordinates of the subject pixel for a first depth and second depth greater than the first depth. Color values may be retrieved for first and second sets of pixels within the first and second circles of confusion with depth values proximate the first and second depths, respectively. The second set of pixels may not include pixels occluded by the first set of pixels. The blurred color value may be selected based on the color values of the first and second sets of pixels.

    摘要翻译: 本发明可以提供用于模糊图像的技术。 图像可以是具有每个像素的颜色值和深度值的光场图像。 该方法可以包括检索图像并计算图像的主题像素的模糊颜色值。 计算模糊颜色值可以包括计算第一深度和第二深度上的第一深度和第二深度的第一和第二混合圈,该第一和第二圆对象像素的坐标在第一深度和第二深度之间。 可以分别在接近第一和第二深度的深度值的第一和第二混合圈内的第一和第二组像素中检索颜色值。 第二组像素可以不包括由第一组像素遮挡的像素。 可以基于第一和第二组像素的颜色值来选择模糊的颜色值。

    OPTIMIZATION OF OPTICAL SYSTEMS FOR IMPROVED LIGHT FIELD CAPTURE AND MANIPULATION
    9.
    发明申请
    OPTIMIZATION OF OPTICAL SYSTEMS FOR IMPROVED LIGHT FIELD CAPTURE AND MANIPULATION 有权
    用于改进光场捕获和操纵的光学系统的优化

    公开(公告)号:US20140146201A1

    公开(公告)日:2014-05-29

    申请号:US13888192

    申请日:2013-05-06

    申请人: Lytro, Inc.

    IPC分类号: H04N9/64 H04N9/04

    摘要: According to various embodiments of the present invention, the optical systems of light field capture devices are optimized so as to improve captured light field image data. Optimizing optical systems of light field capture devices can result in captured light field image data (both still and video) that is cheaper and/or easier to process. Optical systems can be optimized to yield improved quality or resolution when using cheaper processing approaches whose computational costs fit within various processing and/or resource constraints. As such, the optical systems of light field cameras can be optimized to reduce size and/or cost and/or increase the quality of such optical systems.

    摘要翻译: 根据本发明的各种实施例,对光场捕获装置的光学系统进行了优化,以便改善捕获的光场图像数据。 优化光场捕获设备的光学系统可以导致捕获的光场图像数据(静止和视频),其更便宜和/或更容易处理。 当使用更便宜的处理方法(其计算成本适合各种处理和/或资源约束)时,可以优化光学系统以产生改进的质量或分辨率。 因此,光场照相机的光学系统可以被优化以减小尺寸和/或成本和/或提高这种光学系统的质量。

    GENERATION OF VIRTUAL REALITY WITH 6 DEGREES OF FREEDOM FROM LIMITED VIEWER DATA

    公开(公告)号:US20180329485A1

    公开(公告)日:2018-11-15

    申请号:US15897994

    申请日:2018-02-15

    申请人: Lytro, Inc.

    IPC分类号: G06F3/01 G06T19/00 G06T7/536

    摘要: A virtual reality or augmented reality experience may be presented for a viewer through the use of input including only three degrees of freedom. The input may include orientation data indicative of a viewer orientation at which a head of the viewer is oriented. The viewer orientation may be mapped to an estimated viewer location. Viewpoint video may be generated of a scene as viewed from a virtual viewpoint with a virtual location corresponding to the estimated viewer location, from along the viewer orientation. The viewpoint video may be displayed for the viewer. In some embodiments, mapping may be carried out by defining a ray at the viewer orientation, locating an intersection of the ray with a three-dimensional shape, and, based on a location of the intersection, generating the estimated viewer location. The shape may be generated via calibration with a device that receives input including six degrees of freedom.