-
公开(公告)号:US11468629B2
公开(公告)日:2022-10-11
申请号:US17061179
申请日:2020-10-01
Applicant: QUALCOMM Incorporated
Inventor: Bojan Vrcelj , Gerhard Reitmayr , Joseph Daniel Garvey
Abstract: The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.
-
公开(公告)号:US11238664B1
公开(公告)日:2022-02-01
申请号:US17090841
申请日:2020-11-05
Applicant: QUALCOMM Incorporated
Inventor: Mehrad Tavakoli , Robert Tartz , Scott Beith , Gerhard Reitmayr
Abstract: Techniques and systems are provided for providing recommendations for extended reality systems. In some examples, a system determines one or more environmental features associated with a real-world environment of an extended reality system. The system determines one or more user features associated with a user of the extended reality system. The system also outputs, based on the one or more environmental features and the one or more user features, a notification associated with at least one application supported by the extended reality system.
-
公开(公告)号:US11069128B2
公开(公告)日:2021-07-20
申请号:US16640705
申请日:2018-07-24
Applicant: QUALCOMM Incorporated
Inventor: Dieter Schmalstieg , Gerhard Reitmayr , Serafin Diaz Spindola
Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.
-
公开(公告)号:US10403032B2
公开(公告)日:2019-09-03
申请号:US15683613
申请日:2017-08-22
Applicant: QUALCOMM Incorporated
Inventor: Dieter Schmalstieg , Gerhard Reitmayr , Serafin Diaz Spindola
Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.
-
公开(公告)号:US20180192035A1
公开(公告)日:2018-07-05
申请号:US15621716
申请日:2017-06-13
Applicant: QUALCOMM Incorporated
Inventor: Onkar Jayant Dabeer , Gerhard Reitmayr , Ravi Teja Sukhavasi , Kiran Somasundaram , Radhika Dilip Gowaikar
CPC classification number: H04N13/264 , G06F16/86 , G06K9/00798 , G06K9/00818 , G06T3/4007 , G06T5/002 , G06T5/50 , G06T7/73 , G06T2207/10016 , G06T2207/20201 , H04N5/2329 , H04N7/18 , H04N7/181
Abstract: A method performed by an apparatus is described. The method includes receiving a set of image frames including at least one object. The method also includes receiving a camera position for each image frame. The method further includes associating the at least one object between image frames based on one or more object points and the received camera position for each image frame to produce two-dimensional (2D) object location data. The method additionally includes estimating three-dimensional (3D) pose data of the at least one object based on the 2D object location data. The method also includes refining the 3D pose data based on a shape constraint.
-
公开(公告)号:US09674507B2
公开(公告)日:2017-06-06
申请号:US14151776
申请日:2014-01-09
Applicant: QUALCOMM Incorporated
Inventor: Christian Pirchheim , Dieter Schmalstieg , Gerhard Reitmayr
CPC classification number: H04N13/289 , G06T7/579 , H04N5/23238
Abstract: Disclosed are a system, apparatus, and method for monocular visual simultaneous localization and mapping that handles general 6DOF and panorama camera movements. A 3D map of an environment containing features with finite or infinite depth observed in regular or panorama keyframes is received. The camera is tracked in 6DOF from finite, infinite, or mixed feature sets. Upon detection of a panorama camera movement towards unmapped scene regions, a reference panorama keyframe with infinite features is created and inserted into the 3D map. When panoramic camera movement extends toward unmapped scene regions, the reference keyframe is extended with further dependent panorama keyframes. Panorama keyframes are robustly localized in 6DOF with respect to finite 3D map features. Localized panorama keyframes contain 2D observations of infinite map features that are matched with 2D observations in other localized keyframes. 2D-2D correspondences are triangulated, resulting in new finite 3D map features.
-
公开(公告)号:US20160196659A1
公开(公告)日:2016-07-07
申请号:US14866771
申请日:2015-09-25
Applicant: QUALCOMM Incorporated
Inventor: Bojan Vrcelj , Young Hoon Lee , Gerhard Reitmayr
CPC classification number: H04N13/204 , G01B11/22 , G06K9/00214 , G06K9/34 , G06K9/6215 , G06T7/11 , G06T7/12 , G06T7/13 , G06T7/136 , G06T7/50 , G06T2207/10012 , G06T2207/10021 , G06T2207/10028 , G06T2207/30244 , H04N2013/0092
Abstract: Disclosed are a system, apparatus, and method for 3D object segmentation within an environment. Image frames are obtained from one or more depth cameras or at different times and planar segments are extracted from data obtained from the image frames. Candidate segments that comprise a non-planar object surface are identified from the extracted planar segments. In one aspect, certain extracted planar segments are identified as comprising a non-planar object surface, and are referred to as candidate segments. Confidence of preexisting candidate segments are adjusted in response to determining correspondence with a candidate segment. In one aspect, one or more preexisting candidate segments are determined to comprise a surface of a preexisting non-planar object hypothesis. Confidence in the non-planar object hypothesis is updated in response to determining correspondence with a candidate segment.
Abstract translation: 公开了一种用于环境内的3D对象分割的系统,装置和方法。 图像帧从一个或多个深度相机获得或在不同时间获得,并且从从图像帧获得的数据中提取平面片段。 从提取的平面段识别构成非平面物体表面的候选段。 在一个方面,某些提取的平面段被识别为包括非平面物体表面,并且被称为候选段。 响应于确定与候选片段的对应关系,调整预先存在的候选片段的置信度。 在一个方面,一个或多个预先存在的候选片段被确定为包括预先存在的非平面对象假设的表面。 响应于确定与候选片段的对应关系,更新非平面物体假设的置信度。
-
公开(公告)号:US20140323148A1
公开(公告)日:2014-10-30
申请号:US14139856
申请日:2013-12-23
Applicant: QUALCOMM Incorporated
Inventor: Dieter Schmalstieg , Clemens Arth , Johnathan Ventura , Christian Pirchheim , Gerhard Reitmayr
CPC classification number: H04W4/029 , G01C21/005 , G01V3/38
Abstract: Exemplary methods, apparatuses, and systems for performing wide area localization from simultaneous localization and mapping (SLAM) maps are disclosed. A mobile device can select a first keyframe based SLAM map of the local environment with one or more received images. A respective localization of the mobile device within the local environment can be determined, and the respective localization may be based on the keyframe based SLAM map. The mobile device can send the first keyframe to a server and receive a first global localization response representing a correction to a local map on the mobile device. The first global localization response can include rotation, translation, and scale information. A server can receive keyframes from a mobile device, and localize the keyframes within a server map by matching keyframe features received from the mobile device to server map features.
Abstract translation: 公开了用于从同时定位和映射(SLAM)映射执行广域定位的示例性方法,装置和系统。 移动设备可以使用一个或多个接收到的图像来选择本地环境的基于关键帧的第一基于SLAM映射。 可以确定移动设备在本地环境中的相应定位,并且相应的定位可以基于基于关键帧的SLAM映射。 移动设备可以将第一关键帧发送到服务器并且接收表示对移动设备上的本地地图的校正的第一全局定位响应。 第一个全球本地化响应可以包括旋转,翻译和缩放信息。 服务器可以从移动设备接收关键帧,并通过将从移动设备接收到的关键帧功能与服务器映射功能进行匹配来本地化服务器映射中的关键帧。
-
公开(公告)号:US20140126769A1
公开(公告)日:2014-05-08
申请号:US13831405
申请日:2013-03-14
Applicant: QUALCOMM INCORPORATED
Inventor: Gerhard Reitmayr , Alessandro Mulloni
IPC: G06K9/00
CPC classification number: G06K9/00201 , G06T7/12 , G06T7/73 , G06T2207/10016
Abstract: Apparatuses and methods for fast visual simultaneous localization and mapping are described. In one embodiment, a three-dimensional (3D) target is initialized immediately from a first reference image and prior to processing a subsequent image. In one embodiment, one or more subsequent reference images are processed, and the 3D target is tracked in six degrees of freedom. In one embodiment, the 3D target is refined based on the processed the one or more subsequent images.
Abstract translation: 描述了用于快速视觉同时定位和映射的装置和方法。 在一个实施例中,三维(3D)目标被立即从第一参考图像初始化并且在处理随后的图像之前被初始化。 在一个实施例中,处理一个或多个后续参考图像,并且以六个自由度跟踪3D目标。 在一个实施例中,基于处理了一个或多个后续图像来改进3D目标。
-
公开(公告)号:US20130314442A1
公开(公告)日:2013-11-28
申请号:US13802065
申请日:2013-03-13
Applicant: QUALCOMM INCORPORATED
Inventor: Tobias Martin LANGLOTZ , Mathaus Zingerle , Gerhard Reitmayr
CPC classification number: G06T19/006 , G06T11/00 , H04N5/23238
Abstract: A source video stream is processed to extract a desired object from the remainder of video stream to produce a segmented video of the object. Additional relevant information, such as the orientation of the source camera for each frame in the resulting segmented video of the object, is also determined and stored. During replay, the segmented video of the object, as well as the source camera orientation are obtained. Using the source camera orientation for each frame of the segmented video of the object, as well as target camera orientation for each frame of a target video stream, a transformation for the segmented video of the object may be produced. The segmented video of the object may be displayed over the target video stream, which may be a live video stream of a scene, using the transformation to spatially register the segmented video to the target video stream.
Abstract translation: 源视频流被处理以从视频流的剩余部分提取期望的对象以产生对象的分段视频。 还确定并存储附加的相关信息,例如源摄像机对于对象的结果分割视频中的每帧的方向。 在重放期间,获得对象的分割视频以及源摄像头方位。 使用对象的分割视频的每个帧的源摄像机方向以及目标视频流的每个帧的目标摄像机方向,可以产生对象的分割视频的变换。 物体的分割视频可以在目标视频流上显示,目标视频流可以是场景的直播视频流,使用变换来将分割的视频空间注册到目标视频流。
-
-
-
-
-
-
-
-
-