-
公开(公告)号:US09563824B2
公开(公告)日:2017-02-07
申请号:US14739635
申请日:2015-06-15
Applicant: QUALCOMM Incorporated
Inventor: Emilio Maggio , Qi Pan , Gerhard Reitmayr
CPC classification number: G06K9/6277 , G06K9/34 , G06K9/4652 , G06K9/6278 , G06K9/66 , G06T7/90 , H04N1/6086
Abstract: Methods, systems, computer-readable media, and apparatuses for assigning a color class of a defined finite set of colors to at least one sub-region within a test image are presented. A plurality of sub-regions are identified within a test image. A first sub-region color value is determined for a selected first sub-region of the test image. Using the first sub-region color value and a plurality of zero-order probability distributions, a first color class of the defined finite set of colors is determined as a hypothesis color for the first sub-region. A second sub-region color value is determined for a selected second sub-region of the test image. Using the second sub-region color value and a conditional probability distribution conditioned on the hypothesis color for the first sub-region, a second color class of the defined set of colors is determined. The second color class is assigned to the second sub-region.
Abstract translation: 呈现用于将定义的有限颜色集合的颜色分类分配给测试图像内的至少一个子区域的方法,系统,计算机可读介质和装置。 在测试图像内识别多个子区域。 针对测试图像的所选择的第一子区域确定第一子区域颜色值。 使用第一子区域颜色值和多个零阶概率分布,将所定义的有限颜色集合的第一颜色类别确定为第一子区域的假设颜色。 对于测试图像的所选择的第二子区域确定第二子区域颜色值。 使用第二子区域颜色值和对第一子区域的假设颜色进行调节的条件概率分布,确定所定义的一组颜色的第二颜色类别。 第二个颜色类被分配给第二个子区域。
-
公开(公告)号:US09443350B2
公开(公告)日:2016-09-13
申请号:US14730146
申请日:2015-06-03
Applicant: QUALCOMM Incorporated
Inventor: Daniel Wagner , Alessandro Mulloni , Gerhard Reitmayr , Daniel Knoblauch
CPC classification number: G06T17/00 , G06T2200/08 , H04N13/204 , H04N13/254 , H04N13/271
Abstract: Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.
-
43.
公开(公告)号:US09031283B2
公开(公告)日:2015-05-12
申请号:US13719012
申请日:2012-12-18
Applicant: QUALCOMM Incorporated
Inventor: Clemens Arth , Alessandro Mulloni , Gerhard Reitmayr , Dieter Schmalstieg
CPC classification number: G06K9/00671 , G06T7/75 , G06T7/80 , G06T2207/10016 , G06T2207/30244 , H04N5/23238
Abstract: A mobile device uses vision and orientation sensor data jointly for six degree of freedom localization, e.g., in wide-area environments. An image or video stream is captured while receiving geographic orientation data and may be used to generate a panoramic cylindrical map of an environment. A bin of model features stored in a database is accessed based on the geographic orientation data. The model features are from a pre-generated reconstruction of the environment produced from extracted features from a plurality of images of the environment. The reconstruction is registered to a global orientation and the model features are stored in bins based on similar geographic orientations. Features from the panoramic cylindrical map are matched to model features in the bin to produce a set of corresponding features, which are used to determine a position and an orientation of the camera.
Abstract translation: 移动设备使用视觉和姿态传感器数据联合进行六自由度定位,例如在广域环境中。 捕获图像或视频流,同时接收地理取向数据,并且可以用于生成环境的全景圆柱图。 基于地理位置数据访问存储在数据库中的模型特征的一个bin。 模型特征来自从环境的多个图像的提取特征产生的环境的预先生成的重建。 重建被注册到全局方向,并且基于类似的地理位置将模型特征存储在箱中。 全景圆柱形地图的特征与仓中的模型特征相匹配,以产生一组相应的特征,用于确定相机的位置和方向。
-
公开(公告)号:US20150070387A1
公开(公告)日:2015-03-12
申请号:US14250544
申请日:2014-04-11
Applicant: QUALCOMM Incorporated
Inventor: Dieter Schmalstieg , Gerhard Reitmayr , Thanh Quoc Nguyen , Raphael David Andre Grasset , Tobias Martin Langlotz , Hartmut Seichter
IPC: G06T19/00
CPC classification number: G06T19/006 , G06T7/12 , G06T17/00 , G06T2207/10028 , G06T2207/20096 , G06T2207/20101 , H04N13/00
Abstract: Techniques are presented for constructing a digital representation of a physical environment. In some embodiments, a method includes obtaining image data indicative of the physical environment; receiving gesture input data from a user corresponding to at least one location in the physical environment, based on the obtained image data; detecting at least one discontinuity in the physical environment near the at least one location corresponding to the received gesture input data; and generating a digital surface corresponding to a surface in the physical environment, based on the received gesture input data and the at least one discontinuity.
Abstract translation: 提出了构建物理环境的数字表示的技术。 在一些实施例中,一种方法包括获得指示物理环境的图像数据; 基于所获得的图像数据,从与所述物理环境中的至少一个位置对应的用户接收手势输入数据; 检测与所接收的手势输入数据相对应的至少一个位置附近的物理环境中的至少一个不连续性; 以及基于所接收的手势输入数据和所述至少一个不连续性,生成对应于所述物理环境中的表面的数字表面。
-
45.
公开(公告)号:US20140016821A1
公开(公告)日:2014-01-16
申请号:US13719012
申请日:2012-12-18
Applicant: QUALCOMM INCORPORATED
Inventor: Clemens Arth , Alessandro Mulloni , Gerhard Reitmayr , Dieter Schmalstieg
IPC: G06K9/00
CPC classification number: G06K9/00671 , G06T7/75 , G06T7/80 , G06T2207/10016 , G06T2207/30244 , H04N5/23238
Abstract: A mobile device uses vision and orientation sensor data jointly for six degree of freedom localization, e.g., in wide-area environments. An image or video stream is captured while receiving geographic orientation data and may be used to generate a panoramic cylindrical map of an environment. A bin of model features stored in a database is accessed based on the geographic orientation data. The model features are from a pre-generated reconstruction of the environment produced from extracted features from a plurality of images of the environment. The reconstruction is registered to a global orientation and the model features are stored in bins based on similar geographic orientations. Features from the panoramic cylindrical map are matched to model features in the bin to produce a set of corresponding features, which are used to determine a position and an orientation of the camera.
Abstract translation: 移动设备使用视觉和姿态传感器数据联合进行六自由度定位,例如在广域环境中。 捕获图像或视频流,同时接收地理取向数据,并且可以用于生成环境的全景圆柱图。 基于地理位置数据访问存储在数据库中的模型特征的一个bin。 模型特征来自从环境的多个图像的提取特征产生的环境的预先生成的重建。 重建被注册到全局方向,并且基于类似的地理位置将模型特征存储在箱中。 全景圆柱形地图的特征与仓中的模型特征相匹配,以产生一组相应的特征,用于确定相机的位置和方向。
-
公开(公告)号:US12236631B2
公开(公告)日:2025-02-25
申请号:US17484601
申请日:2021-09-24
Applicant: QUALCOMM Incorporated
Inventor: Pushkar Gorur Sheshagiri , Ajit Deepak Gupte , Chiranjib Choudhuri , Gerhard Reitmayr , Youngmin Park
Abstract: Systems and techniques are described herein for processing frames. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a process can include obtaining feature information associated with a feature in a current frame, wherein the feature information is based on one or more previous frames; determining an estimated pose of the apparatus associated with the current frame; obtaining a distance associated with the feature in the current frame; and determining an estimated scale of the feature in the current frame based on the feature information associated with the feature, the estimated pose, and the distance associated with the feature.
-
公开(公告)号:US11748949B2
公开(公告)日:2023-09-05
申请号:US17744484
申请日:2022-05-13
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li Cheng , Kuang-Man Huang , Michel Adib Sarkis , Gerhard Reitmayr , Ning Bi
CPC classification number: G06T17/205 , G06T7/12 , G06T19/006 , G06T2210/56
Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.
-
公开(公告)号:US11748913B2
公开(公告)日:2023-09-05
申请号:US17189105
申请日:2021-03-01
Applicant: QUALCOMM Incorporated
Inventor: Ashar Ali , Gokce Dane , Upal Mahbub , Samuel Sunarjo , Gerhard Reitmayr
CPC classification number: G06T7/97 , G06N3/08 , G06T7/80 , G06T17/20 , G06T2207/20081 , G06T2207/20084
Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using images. An example method can include receiving, via a neural network system, an image of a target and metadata associated with the image and/or a device that captured the image; determining, based on the image and metadata, first 3D mesh parameters of a first 3D mesh of the target, the first 3D mesh parameters and first 3D mesh corresponding to a first reference frame associated with the image and/or the device; and determining, based on the first 3D mesh parameters, second 3D mesh parameters for a second 3D mesh of the target, the second 3D mesh parameters and second 3D mesh corresponding to a second reference frame, the second reference frame including a 3D coordinate system of a real-world scene where the target is located.
-
公开(公告)号:US11682454B2
公开(公告)日:2023-06-20
申请号:US17518485
申请日:2021-11-03
Applicant: QUALCOMM Incorporated
Inventor: Wesley James Holland , Mehrad Tavakoli , Injoon Hong , Huang Huang , Simon Peter William Booth , Gerhard Reitmayr
IPC: G06F1/3287 , G06F3/01 , G06F3/14 , G06T5/00 , G06T19/00 , G11C11/419 , G11C11/412 , H10B10/00
CPC classification number: G11C11/419 , G06F1/3287 , G06F3/013 , G06F3/14 , G06T5/006 , G06T19/006 , G11C11/412 , H10B10/12
Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.
-
公开(公告)号:US11481931B2
公开(公告)日:2022-10-25
申请号:US16922945
申请日:2020-07-07
Applicant: QUALCOMM Incorporated
Inventor: Scott Beith , Robert Tartz , Ananthapadmanabhan Arasanipalai Kandhadai , Gerhard Reitmayr , Mehrad Tavakoli
Abstract: Systems, methods, and non-transitory media are provided for generating virtual private spaces for extended reality (XR) experiences. An example method can include initiating a virtual session for presenting virtual content and identifying, for the virtual session, a portion of a physical space for use as a virtual private space for presenting at least a portion of the virtual content. The method can include outputting boundary information defining a boundary of the virtual private space, and generate at least the portion of the virtual content for the virtual private space. At least the portion of the virtual content is viewable in the virtual private space by one or more authorized users of the virtual session and is not viewable by one or more unauthorized users.
-
-
-
-
-
-
-
-
-