公开(公告)号：US11887262B2

公开(公告)日：2024-01-30

申请号：US17645586

申请日：2021-12-22

Applicant: QUALCOMM Incorporated

Inventor： Mehrad Tavakoli ,  Robert Tartz ,  Scott Beith ,  Gerhard Reitmayr

IPC: G06T19/00 ,  G02B27/00 ,  G02B27/01

CPC classification number: G06T19/006 ,  G02B27/0093 ,  G02B27/017

Abstract: Techniques and systems are provided for providing recommendations for extended reality systems. In some examples, a system determines one or more environmental features associated with a real-world environment of an extended reality system. The system determines one or more user features associated with a user of the extended reality system. The system also outputs, based on the one or more environmental features and the one or more user features, a notification associated with at least one application supported by the extended reality system.

公开(公告)号：US11144117B1

公开(公告)日：2021-10-12

申请号：US16876754

申请日：2020-05-18

Applicant: QUALCOMM Incorporated

Inventor： Chiranjib Choudhuri ,  Ajit Deepak Gupte ,  Pushkar Gorur Sheshagiri ,  Gerhard Reitmayr ,  Tom Edward Botterill

IPC: G06F3/01 ,  G06N20/00 ,  G06N3/04 ,  G06N3/08 ,  G06F3/0346

Abstract: Methods, systems, and devices for deep learning based head motion prediction for extended reality are described. The head pose prediction may involve training one or more layers of a machine learning network based on application data and an estimated head motion range associated with the extended reality system. The network may receive one or more bias corrected inertial measurement unit (IMU) measurements based on a sensor. The network may model a relative head pose of the user as a polynomial of time over a prediction interval based on the bias corrected IMU measurements and the trained one or more layers of the machine learning network. The network may determine a future relative head pose of the user based on the polynomial (e.g., which may be used for virtual object generation, display, etc. within an extended reality system).

公开(公告)号：US10309762B2

公开(公告)日：2019-06-04

申请号：US15182750

申请日：2016-06-15

Applicant: QUALCOMM Incorporated

Inventor： Prince Gupta ,  Daniel Wagner ,  Gerhard Reitmayr ,  Alessandro Mulloni

IPC: G06T7/70 ,  G01B11/00 ,  G06T19/00

Abstract: A method of determining a reference coordinate system includes: obtaining information indicative of a direction of gravity relative to a device; and converting an orientation of a device coordinate system using the direction of gravity relative to the device to produce the reference coordinate system. The method may also include setting an origin of the reference coordinate system and/or determining a scale value of the reference coordinate system. The method may also include refining the reference coordinate system.

公开(公告)号：US20190066365A1

公开(公告)日：2019-02-28

申请号：US15683613

申请日：2017-08-22

Applicant: QUALCOMM Incorporated

Inventor： Dieter Schmalstieg ,  Gerhard Reitmayr ,  Serafin Diaz Spindola

IPC: G06T15/40 ,  G06T15/00 ,  G06T15/80 ,  G06T1/60 ,  G06T17/20 ,  G06T15/04

CPC classification number: G06T15/405 ,  A63F13/50 ,  A63F2300/203 ,  A63F2300/8082 ,  G06T1/60 ,  G06T15/005 ,  G06T15/04 ,  G06T15/10 ,  G06T15/80 ,  G06T17/20 ,  G06T2200/16 ,  G06T2200/24

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.

公开(公告)号：US09934611B2

公开(公告)日：2018-04-03

申请号：US14250544

申请日：2014-04-11

Applicant: QUALCOMM Incorporated

Inventor： Dieter Schmalstieg ,  Gerhard Reitmayr ,  Thanh Quoc Nguyen ,  Raphael David Andre Grasset ,  Tobias Martin Langlotz ,  Hartmut Seichter

IPC: G06T19/00 ,  G06T17/00 ,  H04N13/00 ,  G06T7/12

CPC classification number: G06T19/006 ,  G06T7/12 ,  G06T17/00 ,  G06T2207/10028 ,  G06T2207/20096 ,  G06T2207/20101 ,  H04N13/00

Abstract: Techniques are presented for constructing a digital representation of a physical environment. In some embodiments, a method includes obtaining image data indicative of the physical environment; receiving gesture input data from a user corresponding to at least one location in the physical environment, based on the obtained image data; detecting at least one discontinuity in the physical environment near the at least one location corresponding to the received gesture input data; and generating a digital surface corresponding to a surface in the physical environment, based on the received gesture input data and the at least one discontinuity.

公开(公告)号：US09514574B2

公开(公告)日：2016-12-06

申请号：US14268721

申请日：2014-05-02

Applicant: QUALCOMM Incorporated

Inventor： Gerhard Reitmayr

IPC: G06T19/00 ,  G06T7/00 ,  G06T15/00 ,  G06K9/00

CPC classification number: G06T19/006 ,  G06K9/00201 ,  G06K9/00624 ,  G06T7/70 ,  G06T15/00 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028

Abstract: Methods, systems, computer-readable media, and apparatuses for constructing a representation of a planar object are presented. In some embodiments, techniques for constructing a representation of a planar object are disclosed. According to some embodiments, a method for constructing a representation of a planar object may include obtaining a depth image of a physical scene as captured from a viewing position. The depth image may comprise a plurality of depth values and corresponding to a plurality of points in the physical scene. The method may further include identifying a planar surface along which the planar object is estimated to be positioned. Furthermore, the method may include constructing a support map. Moreover, the method may include constructing an occlusion map, the occlusion map indicating portions of the planar surface where the planar object is missing. Subsequently, the method may include constructing a representation of at least one boundary of the planar object, using the occlusion map.

Abstract translation: 提出了用于构建平面对象的表示的方法，系统，计算机可读介质和装置。 在一些实施例中，公开了用于构建平面对象的表示的技术。 根据一些实施例，用于构建平面对象的表示的方法可以包括从观看位置获取物理场景的深度图像。 深度图像可以包括多个深度值并且对应于物理场景中的多个点。 该方法还可以包括识别平面物体沿着该平面被估计定位的平面。 此外，该方法可以包括构建支持图。 此外，该方法可以包括构造遮挡图，遮挡图指示平面物体丢失的平面的部分。 随后，该方法可以包括使用遮挡图来构建平面物体的至少一个边界的表示。

公开(公告)号：US20150062117A1

公开(公告)日：2015-03-05

申请号：US14268721

申请日：2014-05-02

Applicant: QUALCOMM Incorporated

Inventor： Gerhard Reitmayr

IPC: G06T19/00 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06K9/00201 ,  G06K9/00624 ,  G06T7/70 ,  G06T15/00 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028

Abstract: Methods, systems, computer-readable media, and apparatuses for constructing a representation of a planar object are presented. In some embodiments, techniques for constructing a representation of a planar object are disclosed. According to some embodiments, a method for constructing a representation of a planar object may include obtaining a depth image of a physical scene as captured from a viewing position. The depth image may comprise a plurality of depth values and corresponding to a plurality of points in the physical scene. The method may further include identifying a planar surface along which the planar object is estimated to be positioned. Furthermore, the method may include constructing a support map. Moreover, the method may include constructing an occlusion map, the occlusion map indicating portions of the planar surface where the planar object is missing. Subsequently, the method may include constructing a representation of at least one boundary of the planar object, using the occlusion map.

Abstract translation: 提出了用于构建平面对象的表示的方法，系统，计算机可读介质和装置。 在一些实施例中，公开了用于构建平面对象的表示的技术。 根据一些实施例，用于构建平面对象的表示的方法可以包括从观看位置获取物理场景的深度图像。 深度图像可以包括多个深度值并且对应于物理场景中的多个点。 该方法还可以包括识别平面物体沿着该平面被估计定位的平面。 此外，该方法可以包括构建支持图。 此外，该方法可以包括构造遮挡图，遮挡图指示平面物体丢失的平面的部分。 随后，该方法可以包括使用遮挡图来构建平面物体的至少一个边界的表示。

公开(公告)号：US12224002B2

公开(公告)日：2025-02-11

申请号：US18313930

申请日：2023-05-08

Applicant: QUALCOMM Incorporated

Inventor： Wesley James Holland ,  Mehrad Tavakoli ,  Injoon Hong ,  Huang Huang ,  Simon Peter William Booth ,  Gerhard Reitmayr

IPC: G06F1/3287 ,  G06F3/01 ,  G06F3/14 ,  G06T5/80 ,  G06T19/00 ,  G11C11/412 ,  G11C11/419 ,  H10B10/00

Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

公开(公告)号：US20230096553A1

公开(公告)日：2023-03-30

申请号：US17449621

申请日：2021-09-30

Applicant: QUALCOMM Incorporated

Inventor： Hussein Metwaly Saad ,  Peerapol Tinnakornsrisuphap ,  Prashanth Haridas Hande ,  Gerhard Reitmayr ,  Abhijeet Bisain ,  Chih-Ping Li

IPC: H04B7/06 ,  H04B7/0456 ,  G01S13/89 ,  H04W36/06

Abstract: This disclosure provides systems, methods, and devices for wireless communication that support enhanced beam management using extended reality (XR) perception data. In a first aspect, a method of wireless communication includes establishing a communication connection between a user equipment (UE) and a serving base station using a current serving beam selected by the UE from a plurality of available beams paired with a serving base station beam. The method further includes obtaining, perception information from one or more extended reality sensors associated with the UE and determining, in response to detection of UE movement, a transpositional representation of the movement using the perception information. The UE may then select a new serving beam in accordance with the transpositional representation. Other aspects and features are also claimed and described.

公开(公告)号：US11514658B2

公开(公告)日：2022-11-29

申请号：US17153773

申请日：2021-01-20

Applicant: QUALCOMM Incorporated

Inventor： Ashar Ali ,  Gokee Dane ,  Gerhard Reitmayr

IPC: G06T17/20 ,  G06T19/20 ,  G06T15/20

Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using multi-view image data. An example method can include determining, based on a first image of a target, first 3D mesh parameters for the target corresponding to a first coordinate frame; determining, based on a second image of the target, second 3D mesh parameters for the target corresponding to a second coordinate frame; determining third 3D mesh parameters for the target in a third coordinate frame, the third 3D mesh parameters being based on the first and second 3D mesh parameters and relative rotation and translation parameters of image sensors that captured the first and second images; determining a loss associated with the third 3D mesh parameters, the loss being based on the first and second 3D mesh parameters and the relative rotation and translation parameters; determining 3D mesh parameters based on the loss and third 3D mesh parameters.