公开(公告)号：US20210144283A1

公开(公告)日：2021-05-13

申请号：US16488279

申请日：2017-07-26

申请人： Kshitij MARWAH

发明人： Kshitij MARWAH

IPC分类号： H04N5/225 ,  H04N5/232 ,  G06T3/40 ,  G06T5/00 ,  H04N5/235 ,  H04N5/262

摘要： A 360-degree Virtual Reality Snap-On Camera that can be connected to any mobile device using the micro-USB, USB-C connector or Lightning connector along with the corresponding mobile application to capture 360-degree and Virtual Reality (VR) Videos is provided. The device consists of two or more cameras with a high-field of lenses connected through a microcontroller or microprocessor. The streams are interpreted, decoded and analyzed by the mobile application through the microcontroller or microprocessor, and mapped by inbuilt Graphics Processing Unit optimized stitching and blending method for a 360-degree VR video experience. The method can perform VR facial filters, VR Avatars and Augmented Reality spatial tracking over the VR Streams. The stream can be further compressed using optimized method for delivery over the cloud networks and can then be shared across social networks, live streamed and viewed either stand-alone or with a VR headset.

公开(公告)号：US20140240532A1

公开(公告)日：2014-08-28

申请号：US14192800

申请日：2014-02-27

申请人： Kshitij Marwah ,  Gordon Wetzstein ,  Ramesh Raskar

发明人： Kshitij Marwah ,  Gordon Wetzstein ,  Ramesh Raskar

IPC分类号： H04N5/262

CPC分类号： H04N5/2621 ,  H04N5/2254

摘要： In exemplary implementations of this invention, a light field camera uses a light field dictionary to reconstruct a 4D light field from a single photograph. The light field includes both angular and spatial information and has a spatial resolution equal to the spatial resolution of the imaging sensor. Light from a scene passes through a coded spatial light modulator (SLM) before reaching an imaging sensor. Computer processors reconstruct a light field. This reconstruction includes computing a sparse or compressible coefficient vector using a light field dictionary matrix. Each column vector of the dictionary matrix is a light field atom. These light field atoms each, respectively, comprise information about a small 4D region of a light field. Reconstruction quality may be improved by using an SLM that is as orthogonal as possible to the dictionary.

摘要翻译： 在本发明的示例性实施方案中，光场照相机使用光场辞典从单张照片重建4D光场。 光场包括角度和空间信息，并且具有等于成像传感器的空间分辨率的空间分辨率。 来自场景的光在到达成像传感器之前通过编码的空间光调制器（SLM）。 计算机处理器重建光场。 该重建包括使用光场字典矩阵来计算稀疏或可压缩的系数向量。 字典矩阵的每个列向量都是一个光场原子。 这些光场原子各自分别包括关于光场的小4D区域的信息。 可以通过使用与字典尽可能正交的SLM来改善重建质量。

公开(公告)号：US09380221B2

公开(公告)日：2016-06-28

申请号：US14192800

申请日：2014-02-27

申请人： Kshitij Marwah ,  Gordon Wetzstein ,  Ramesh Raskar

发明人： Kshitij Marwah ,  Gordon Wetzstein ,  Ramesh Raskar

IPC分类号： H04N5/225 ,  H04N5/228 ,  G02B26/00 ,  H04N5/262

CPC分类号： H04N5/2621 ,  H04N5/2254

摘要： In exemplary implementations of this invention, a light field camera uses a light field dictionary to reconstruct a 4D light field from a single photograph. The light field includes both angular and spatial information and has a spatial resolution equal to the spatial resolution of the imaging sensor. Light from a scene passes through a coded spatial light modulator (SLM) before reaching an imaging sensor. Computer processors reconstruct a light field. This reconstruction includes computing a sparse or compressible coefficient vector using a light field dictionary matrix. Each column vector of the dictionary matrix is a light field atom. These light field atoms each, respectively, comprise information about a small 4D region of a light field. Reconstruction quality may be improved by using an SLM that is as orthogonal as possible to the dictionary.

摘要翻译： 在本发明的示例性实施方案中，光场照相机使用光场辞典从单张照片重建4D光场。 光场包括角度和空间信息，并且具有等于成像传感器的空间分辨率的空间分辨率。 来自场景的光在到达成像传感器之前通过编码的空间光调制器（SLM）。 计算机处理器重建光场。 该重建包括使用光场字典矩阵来计算稀疏或可压缩的系数向量。 字典矩阵的每个列向量都是一个光场原子。 这些光场原子各自分别包括关于光场的小4D区域的信息。 可以通过使用与字典尽可能正交的SLM来改善重建质量。