-
公开(公告)号:US10460515B2
公开(公告)日:2019-10-29
申请号:US15865129
申请日:2018-01-08
申请人: Jaunt, Inc.
发明人: Simion Venshtain , Po-Han Huang
IPC分类号: G06T17/20 , G06T19/20 , G06F3/0481 , H04N7/15 , G06T7/73 , H04N13/214 , G06K9/00 , G06K9/46 , G06K9/62 , G06T15/20 , H04N7/14 , G06T19/00 , H04L29/06 , G06K9/20 , G06T15/08 , H04L12/18
摘要: Systems and methods relate to encoded video streams including geometric-data streams transmitted to a receiver for rendering of a viewpoint-adaptive 3D persona. A method includes obtaining a three-dimensional (3D) mesh of a subject generated from depth-camera-captured information about the subject, obtaining a facial-mesh model, locating a facial portion of the obtained 3D mesh of the subject, computing a geometric transform based on the facial portion and the facial-mesh model, the geometric transform determined in response to one or more aggregated error differences between a plurality of feature points on the facial-mesh model and a plurality of corresponding feature points on the facial portion of the obtained 3D mesh, generating a transformed facial-mesh model using the geometric transform and generating a hybrid mesh of the subject at least in part by combining the transformed facial-mesh model and at least a portion of the obtained 3D mesh.
-
公开(公告)号:US20190045178A1
公开(公告)日:2019-02-07
申请号:US16157873
申请日:2018-10-11
申请人: Jaunt Inc.
发明人: Rory LUTTER , Andrew Walkingshaw
IPC分类号: H04N13/366 , H04N19/172 , H04N19/119 , H04N19/597 , H04N13/344 , H04N19/162
摘要: A method includes generating a set of three-dimensional (3D) virtual reality videos by stitching together image frames of one or more environments captured by a camera array. The method further includes generating graphical data for displaying a virtual reality user interface that includes (1) selectable icons that correspond to the set of 3D virtual reality videos and (2) an object. The method further includes receiving, from a peripheral device, a selection of the object by a user of the peripheral device in the virtual reality user interface and an indication of a desire to move the object to be positioned in front of a first 3D virtual reality video from the set of virtual reality videos. The method further includes providing a first 3D preview of the first 3D virtual reality video within the object.
-
-
公开(公告)号:US09930238B2
公开(公告)日:2018-03-27
申请号:US14465581
申请日:2014-08-21
申请人: Jaunt Inc.
IPC分类号: H04N5/232 , H04N13/02 , G11B27/11 , G11B27/34 , G11B31/00 , H04N13/00 , G06F3/0481 , G06F3/0484 , G06Q30/02 , G06T3/40 , G06T7/00 , H04N5/247 , H04N7/18
CPC分类号: H04N5/23206 , G06F3/013 , G06F3/04815 , G06F3/04847 , G06Q30/0246 , G06Q30/0263 , G06Q30/0269 , G06Q30/0273 , G06Q30/0277 , G06Q30/0284 , G06Q50/01 , G06T3/4038 , G06T7/97 , G06T19/006 , G06T2207/10012 , G06T2207/20228 , G11B27/11 , G11B27/34 , G11B31/006 , H04N5/23238 , H04N5/247 , H04N7/181 , H04N13/106 , H04N13/111 , H04N13/204 , H04N13/243 , H04N13/271
摘要: The disclosure includes a system and method for stitching image frames. The system includes a processor and a memory storing instructions that, when executed, cause the system to: receive image frames that are captured by two or more camera modules at a particular time; interpolate a virtual camera between a first set of camera modules from the two or more camera modules; determine a set of disparity maps between the first set of camera modules; generate, based on the set of disparity maps, a virtual camera image associated with the particular time for the virtual camera from a set of image frames captured by the first set of camera modules at the particular time; and construct a left panoramic image and a right panoramic image associated with the particular time from the image frames captured by the two or more camera modules and the virtual camera image.
-
公开(公告)号:US20170236162A1
公开(公告)日:2017-08-17
申请号:US15585154
申请日:2017-05-02
申请人: JAUNT INC.
摘要: The disclosure includes a system and method for generating virtual reality content. For example, the disclosure includes a method for generating virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data with a processor-based computing device programmed to perform the generating, providing the virtual reality content to a user, detecting a location of the user's gaze at the virtual reality content, and suggesting an advertisement based on the location of the user's gaze. Another example includes receiving virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data to a first user with a processor-based computing device programmed to perform the receiving, generating a social network for the first user, and generating a social graph that includes user interactions with the virtual reality content.
-
公开(公告)号:US20170236149A1
公开(公告)日:2017-08-17
申请号:US15585157
申请日:2017-05-02
申请人: JAUNT INC.
摘要: The disclosure includes a system and method for generating virtual reality content. For example, the disclosure includes a method for generating virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data with a processor-based computing device programmed to perform the generating, providing the virtual reality content to a user, detecting a location of the user's gaze at the virtual reality content, and suggesting an advertisement based on the location of the user's gaze. Another example includes receiving virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data to a first user with a processor-based computing device programmed to perform the receiving, generating a social network for the first user, and generating a social graph that includes user interactions with the virtual reality content.
-
公开(公告)号:US20160191815A1
公开(公告)日:2016-06-30
申请号:US14810479
申请日:2015-07-28
申请人: Jaunt Inc.
CPC分类号: H04N5/247 , G06Q30/0263 , G06T3/4038 , G06T7/97 , G06T19/006 , G06T2207/10012 , G06T2207/20228 , H04N5/2258 , H04N5/23238 , H04N7/181 , H04N13/106 , H04N13/111 , H04N13/243 , H04N13/271
摘要: The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules. Lens distortion effects may be removed from the frames described by the video data. The camera modules of the camera array are configured to provide a 3× field of view overlap.
摘要翻译: 本发明包括一种包括相机模块的相机阵列,所述相机模块包括包括处理器,存储器,传感器,透镜,状态指示器和开关的主摄像机,所述开关被配置为指示每个相机模块 启动开始操作以使用其他相机模块中的透镜和传感器开始记录视频数据,并且配置为指示每个相机模块开始停止操作以停止记录的开关,该状态指示器被配置为指示在 至少有一个相机模块。 可以从视频数据描述的帧中去除镜头失真效应。 相机阵列的相机模块被配置为提供3×视场重叠。
-
公开(公告)号:US20150348580A1
公开(公告)日:2015-12-03
申请号:US14726118
申请日:2015-05-29
申请人: Jaunt Inc.
CPC分类号: G11B19/20 , G06Q30/0263 , G06T1/0007 , G06T3/4038 , H04N5/2258 , H04N5/23238 , H04N5/247 , H04N5/772 , H04N7/181 , H04N13/106 , H04N13/111 , H04N13/189 , H04N13/243 , H04N13/271
摘要: The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules. The camera modules of the camera array are configured to provide a 3× field of view overlap.
摘要翻译: 本发明包括一种包括相机模块的相机阵列,所述相机模块包括包括处理器,存储器,传感器,透镜,状态指示器和开关的主摄像机,所述开关被配置为指示每个相机模块 启动开始操作以使用其他相机模块中的透镜和传感器开始记录视频数据,并且配置为指示每个相机模块开始停止操作以停止记录的开关,该状态指示器被配置为指示在 至少有一个相机模块。 相机阵列的相机模块被配置为提供3×视场重叠。
-
9.
公开(公告)号:US20150055937A1
公开(公告)日:2015-02-26
申请号:US14465575
申请日:2014-08-21
申请人: Jaunt Inc.
IPC分类号: H04N13/00 , H04N13/02 , G11B27/031
CPC分类号: H04N13/117 , H04N13/189 , H04N13/243 , H04N13/282
摘要: The disclosure includes a system and method for aggregating image frames and audio data to generate virtual reality content. The system includes a processor and a memory storing instructions that, when executed, cause the system to: receive video data describing image frames from a camera array; receive audio data from a microphone array; aggregate the image frames to generate a stream of three-dimensional (3D) video data, the stream of 3D video data including a stream of left panoramic images and a stream of right panoramic images; generate a stream of 3D audio data from the audio data; and generate virtual reality content that includes the stream of 3D video data and the stream of 3D audio data.
摘要翻译: 本公开包括用于聚合图像帧和音频数据以生成虚拟现实内容的系统和方法。 该系统包括处理器和存储指令的存储器,所述指令在被执行时使得系统:从相机阵列接收描述图像帧的视频数据; 从麦克风阵列接收音频数据; 聚合图像帧以产生三维(3D)视频数据流,所述3D视频数据流包括左全景图像流和右全景图像流; 从音频数据生成3D音频数据流; 并生成包括3D视频数据流和3D音频数据流的虚拟现实内容。
-
公开(公告)号:US20150055929A1
公开(公告)日:2015-02-26
申请号:US14444938
申请日:2014-07-28
申请人: Jaunt Inc.
CPC分类号: H04N5/23206 , G06F3/013 , G06F3/04815 , G06F3/04847 , G06Q30/0246 , G06Q30/0263 , G06Q30/0269 , G06Q30/0273 , G06Q30/0277 , G06Q30/0284 , G06Q50/01 , G06T3/4038 , G06T7/97 , G06T19/006 , G06T2207/10012 , G06T2207/20228 , G11B27/11 , G11B27/34 , G11B31/006 , H04N5/23238 , H04N5/247 , H04N7/181 , H04N13/106 , H04N13/111 , H04N13/204 , H04N13/243 , H04N13/271
摘要: The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules.
摘要翻译: 本发明包括一种包括相机模块的相机阵列,所述相机模块包括包括处理器,存储器,传感器,透镜,状态指示器和开关的主摄像机,所述开关被配置为指示每个相机模块 启动开始操作以使用其他相机模块中的透镜和传感器开始记录视频数据,并且配置为指示每个相机模块开始停止操作以停止记录的开关,该状态指示器被配置为指示在 至少有一个相机模块。
-
-
-
-
-
-
-
-
-