-
公开(公告)号:US20130321396A1
公开(公告)日:2013-12-05
申请号:US13599170
申请日:2012-08-30
申请人: Adam Kirk , Kanchan Mitra , Patrick Sweeney , Don Gillett , Neil Fishman , Simon Winder , Yaron Eshet , David Harnett , Amit Mital , David Eraker
发明人: Adam Kirk , Kanchan Mitra , Patrick Sweeney , Don Gillett , Neil Fishman , Simon Winder , Yaron Eshet , David Harnett , Amit Mital , David Eraker
IPC分类号: G06T15/00
CPC分类号: G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要: Free viewpoint video of a scene is generated and presented to a user. An arrangement of sensors generates streams of sensor data each of which represents the scene from a different geometric perspective. The sensor data streams are calibrated. A scene proxy is generated from the calibrated sensor data streams. The scene proxy geometrically describes the scene as a function of time and includes one or more types of geometric proxy data which is matched to a first set of current pipeline conditions in order to maximize the photo-realism of the free viewpoint video resulting from the scene proxy at each point in time. A current synthetic viewpoint of the scene is generated from the scene proxy. This viewpoint generation maximizes the photo-realism of the current synthetic viewpoint based upon a second set of current pipeline conditions. The current synthetic viewpoint is displayed.
摘要翻译: 生成场景的自由视点视频并呈现给用户。 传感器的布置产生传感器数据流,每个传感器数据从不同的几何视角表示场景。 传感器数据流被校准。 从校准的传感器数据流生成场景代理。 场景代理将场景几何描述为时间的函数,并且包括与当前流水线条件的第一组匹配的一种或多种类型的几何代理数据,以便最大化场景产生的自由视点视频的照片真实性 代理在每个时间点。 从场景代理产生现场的合成视点。 该视点生成基于第二组当前流水线条件使当前合成视点的照片真实性最大化。 显示当前的综合观点。
-
公开(公告)号:US20130321586A1
公开(公告)日:2013-12-05
申请号:US13588917
申请日:2012-08-17
申请人: Adam Kirk , Patrick Sweeney , Don Gillett , Neil Fishman , Kanchan Mitra , Amit Mital , David Harnett , Yaron Eshet , Simon Winder , David Eraker
发明人: Adam Kirk , Patrick Sweeney , Don Gillett , Neil Fishman , Kanchan Mitra , Amit Mital , David Harnett , Yaron Eshet , Simon Winder , David Eraker
IPC分类号: H04N13/02
CPC分类号: G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要: Cloud based FVV streaming technique embodiments presented herein generally employ a cloud based FVV pipeline to create, render and transmit FVV frames depicting a captured scene as would be viewed from a current synthetic viewpoint selected by an end user and received from a client computing device. The FVV frames use a similar level of bandwidth as a conventional streaming movie would consume. To change viewpoints, a new viewpoint is sent from the client to the cloud, and a new streaming movie is initiated from the new viewpoint. Frames associated with that viewpoint are created, rendered and transmitted to the client until a new viewpoint request is received.
摘要翻译: 本文呈现的基于云的FVV流技术实施例通常使用基于云的FVV流水线来创建,呈现和发送描绘所捕获场景的FVV帧,如将从最终用户选择并从客户端计算设备接收的当前合成视点所观察到的。 FVV帧使用与传统流式电影将消耗的类似的带宽水平。 为了改变观点,从客户端向云端发送一个新的观点,从新的角度出发新的流媒体电影。 与该视点相关联的帧被创建,呈现并发送到客户端,直到接收到新的视点请求为止。
-
公开(公告)号:US20130095920A1
公开(公告)日:2013-04-18
申请号:US13273213
申请日:2011-10-13
申请人: Kestutis Patiejunas , Kanchan Mitra , Patrick Sweeney , Yaron Eshet , Adam G. Kirk , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , David Harnett , Amit Mital , Simon Winder
发明人: Kestutis Patiejunas , Kanchan Mitra , Patrick Sweeney , Yaron Eshet , Adam G. Kirk , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , David Harnett , Amit Mital , Simon Winder
CPC分类号: G06T15/00 , G06T7/521 , G06T7/593 , G06T15/04 , G06T17/20 , G06T2207/10021 , G06T2207/10024 , G06T2207/10048 , G06T2207/20228 , H04N13/111 , H04N13/271 , H04N2013/0081
摘要: Methods and systems for generating free viewpoint video using an active infrared (IR) stereo module are provided. The method includes computing a depth map for a scene using an active IR stereo module. The depth map may be computed by projecting an IR dot pattern onto the scene, capturing stereo images from each of two or more synchronized IR cameras, detecting dots within the stereo images, computing feature descriptors corresponding to the dots in the stereo images, computing a disparity map between the stereo images, and generating the depth map using the disparity map. The method also includes generating a point cloud for the scene using the depth map, generating a mesh of the point cloud, and generating a projective texture map for the scene from the mesh of the point cloud. The method further includes generating the video for the scene using the projective texture map.
摘要翻译: 提供了使用主动红外(IR)立体声模块产生免费视点视频的方法和系统。 该方法包括使用主动IR立体声模块来计算场景的深度图。 可以通过将IR点图案投影到场景上来计算深度图,从两个或更多个同步红外相机中的每一个拍摄立体图像,检测立体图像内的点,计算与立体图像中的点相对应的特征描述符, 立体图像之间的视差图,并使用视差图生成深度图。 该方法还包括使用深度图生成场景的点云,生成点云的网格,并从点云的网格生成场景的投影纹理贴图。 该方法还包括使用投影纹理图生成场景的视频。
-
公开(公告)号:US20130321575A1
公开(公告)日:2013-12-05
申请号:US13598747
申请日:2012-08-30
申请人: Adam Kirk , Neil Fishman , Don Gillett , Patrick Sweeney , Kanchan Mitra , David Eraker
发明人: Adam Kirk , Neil Fishman , Don Gillett , Patrick Sweeney , Kanchan Mitra , David Eraker
IPC分类号: H04N13/00
CPC分类号: G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要: A “Dynamic High Definition Bubble Framework” allows local clients to display and navigate FVV of complex multi-resolution and multi-viewpoint scenes while reducing computational overhead and bandwidth for rendering and/or transmitting the FVV. Generally, the FVV is presented to the user as a broad area from some distance away. Then, as the user zooms in or changes viewpoints, one or more areas of the overall area are provided in higher definition or fidelity. Therefore, rather than capturing and providing high definition everywhere (at high computational and bandwidth costs), the Dynamic High Definition Bubble Framework captures one or more “bubbles” or volumetric regions in higher definition in locations where it is believed that the user will be most interested. This information is then provided to the client to allow individual clients to navigate and zoom different regions of the FVV during playback without losing fidelity or resolution in the zoomed areas.
摘要翻译: “动态高清晰度气泡框架”允许本地客户端显示和浏览复杂多分辨率和多视点场景的FVV,同时减少渲染和/或传输FVV的计算开销和带宽。 通常,将FVV作为距离一段距离的广泛区域呈现给用户。 然后,当用户放大或改变视点时,以更高的清晰度或保真度提供整个区域的一个或多个区域。 因此,动态高清晰度泡沫框架(Dynamic High Definition Bubble Framework,动态高清晰度气泡框架)可以捕获和提供高清晰度(高计算和带宽成本),而是在相信用户最多的位置捕获更高清晰度的一个或多个“气泡”或体积区域 有兴趣 然后将该信息提供给客户端,以允许单个客户端在播放期间导航和缩放FVV的不同区域,而不会在缩放区域中失去保真度或分辨率。
-
公开(公告)号:US20130321593A1
公开(公告)日:2013-12-05
申请号:US13598536
申请日:2012-08-29
IPC分类号: H04N13/04
CPC分类号: G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要: The view frustum culling technique described herein allows Free Viewpoint Video (FVV) or other 3D spatial video rendering at a client by sending only the 3D geometry and texture (e.g., RGB) data necessary for a specific viewpoint or view frustum from a server to the rendering client. The synthetic viewpoint is then rendered by the client by using the received geometry and texture data for the specific viewpoint or view frustum. In some embodiments of the view frustum culling technique, the client has both some texture data and 3D geometric data stored locally if there is sufficient local processing power. Additionally, in some embodiments, additional spatial and temporal data can be sent to the client to support changes in the view frustum by providing additional geometry and texture data that will likely be immediately used if the viewpoint is changed either spatially or temporally.
摘要翻译: 本文描述的视锥形截尾技术允许仅通过将特定视点或视锥体所需的3D几何和纹理(例如,RGB)数据从服务器发送到客户端,从而在客户端处进行自由视点视频(FVV)或其他3D空间视频呈现 渲染客户端。 合成视点然后由客户端通过使用接收到的几何和纹理数据为特定视点或视图截面呈现。 在视锥形截尾技术的一些实施例中,如果存在足够的局部处理能力,则客户端具有存储在本地的一些纹理数据和3D几何数据。 另外,在一些实施例中,可以向客户端发送额外的空间和时间数据,以通过提供额外的几何形状和纹理数据来支持观看平截头体的变化,如果视点在空间上或时间上都是改变的,则几何和纹理数据可能会立即被使用。
-
公开(公告)号:US08917270B2
公开(公告)日:2014-12-23
申请号:US13599263
申请日:2012-08-30
申请人: Patrick Sweeney , Don Gillett
发明人: Patrick Sweeney , Don Gillett
CPC分类号: G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要: Video of a scene is generated and presented to a user. A stream of mesh models of the scene and a corresponding stream of mesh texture maps are generated from one or more streams of sensor data that represent the scene. Each of the mesh models includes a collection of faces, and each of the mesh texture maps defines texture data for one or more points on the faces. Each of the mesh models is broken down into convex sections. Each of the convex sections is surrounded with a three-dimensional hull. The texture data that is associated with each of the faces in the convex section is projected onto the three-dimensional hull, and a hull texture map for the convex section is produced.
摘要翻译: 生成场景的视频并呈现给用户。 从表示场景的一个或多个传感器数据流生成场景的网格模型流和相应的网格纹理图像流。 每个网格模型都包含一组面部,每个网格纹理贴图定义面上一个或多个点的纹理数据。 每个网格模型都分解为凸形部分。 每个凸部被三维船体包围。 与凸部中的每个面相关联的纹理数据被投影到三维船体上,并且产生用于凸部的船体纹理图。
-
公开(公告)号:US20130321410A1
公开(公告)日:2013-12-05
申请号:US13599263
申请日:2012-08-30
申请人: Patrick Sweeney , Don Gillett
发明人: Patrick Sweeney , Don Gillett
IPC分类号: G06T17/00
CPC分类号: G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要: Video of a scene is generated and presented to a user. A stream of mesh models of the scene and a corresponding stream of mesh texture maps are generated from one or more streams of sensor data that represent the scene. Each of the mesh models includes a collection of faces, and each of the mesh texture maps defines texture data for one or more points on the faces. Each of the mesh models is broken down into convex sections. Each of the convex sections is surrounded with a three-dimensional hull. The texture data that is associated with each of the faces in the convex section is projected onto the three-dimensional hull, and a hull texture map for the convex section is produced.
摘要翻译: 生成场景的视频并呈现给用户。 从表示场景的一个或多个传感器数据流生成场景的网格模型流和相应的网格纹理图像流。 每个网格模型都包含一组面部,每个网格纹理贴图定义面上一个或多个点的纹理数据。 每个网格模型都分解为凸形部分。 每个凸部被三维船体包围。 与凸部中的每个面相关联的纹理数据被投影到三维船体上,并且产生用于凸部的船体纹理图。
-
公开(公告)号:US20100187062A1
公开(公告)日:2010-07-29
申请号:US12689535
申请日:2010-01-19
CPC分类号: A45C13/262 , A45C5/14 , A45C9/00 , A45F2005/002 , A45F2200/0525
摘要: A portable luggage device includes a case, and spaced apart telescoping sections carried by the case that are extendable between a retracted position and an extended position. An inner handle is coupled to exposed ends of the telescoping sections. An outer handle encloses the inner handle, and support arms are coupled to the outer handle for supporting a laptop computer. The outer handle is rotatable with respect to the inner handle between a stowed position defined by the support arms aligned with the telescoping sections, and a deployed position defined by the support arms extending outwards from the telescoping sections.
摘要翻译: 便携式行李箱装置包括壳体和由壳体承载的间隔开的伸缩部分,其可在缩回位置和延伸位置之间延伸。 内手柄连接到伸缩部分的暴露端。 外部手柄包围内部手柄,支撑臂联接到外部手柄以支撑笔记本电脑。 外手柄可相对于内手柄旋转,位于由与伸缩部分对准的支撑臂所限定的收起位置之间,以及由伸缩部分向外延伸的支撑臂限定的展开位置。
-
公开(公告)号:US20070132583A1
公开(公告)日:2007-06-14
申请号:US11164862
申请日:2005-12-08
申请人: Patrick Sweeney
发明人: Patrick Sweeney
IPC分类号: G08B13/14
CPC分类号: G06K7/10336 , G06K7/0008 , G06Q20/203
摘要: A system and method for optimally placing radio frequency identification (RFID) antennas. The system varies the placement of RFID tag and interrogator antennas with respect to each other and a stationary object or objects. A signal generator sends a known reference signal to the one or more RFID interrogator antennas. The signal is received by the one or more RFID tag antennas and is displayed upon an oscilloscope, spectrum analyzer or other multipurpose signal measuring device. By this method, the system finds the optimal placement of the antennas with respect to each other and the object or objects.
摘要翻译: 一种用于最佳地放置射频识别(RFID)天线的系统和方法。 该系统改变RFID标签和询问器天线相对于彼此的位置和固定的物体或物体。 信号发生器向一个或多个RFID询问器天线发送已知的参考信号。 该信号由一个或多个RFID标签天线接收,并被显示在示波器,频谱分析仪或其他多功能信号测量装置上。 通过这种方法,系统发现天线相对于彼此和对象或物体的最佳布置。
-
公开(公告)号:US20070061744A1
公开(公告)日:2007-03-15
申请号:US11457711
申请日:2006-07-14
申请人: Adam Smith , Robert Wlodarczyk , Biliana Kaneva , Eduardo Maia , Patrick Sweeney , Rahul Patil , Sriram Subramanian
发明人: Adam Smith , Robert Wlodarczyk , Biliana Kaneva , Eduardo Maia , Patrick Sweeney , Rahul Patil , Sriram Subramanian
CPC分类号: G06F9/451
摘要: Methods and systems for applying visual effects to active content, such as buttons, comboboxes, video, edit fields, etc., wherein interactivity of the active content are retained thereafter. Also, the present disclosure provides a mechanism for developers to build new visual effects and have them applied to active content.
摘要翻译: 将视觉效果应用于活动内容(如按钮,组合框,视频,编辑字段等)的方法和系统,其中活动内容的交互性在此之后被保留。 此外,本公开提供了开发人员构建新的视觉效果并将其应用于活动内容的机制。
-
-
-
-
-
-
-
-
-