公开(公告)号：US10789776B2

公开(公告)日：2020-09-29

申请号：US15902248

申请日：2018-02-22

Applicant: QUALCOMM Incorporated

Inventor： Dieter Schmalstieg ,  Gerhard Reitmayr ,  Thanh Quoc Nguyen ,  Raphael Grasset ,  Tobias Langlotz ,  Hartmut Seichter

IPC: G06T19/00 ,  G06T17/00 ,  G06T7/12 ,  H04N13/00

Abstract: Techniques are presented for constructing a digital representation of a physical environment. In some embodiments, a method includes obtaining image data indicative of the physical environment; receiving gesture input data from a user corresponding to at least one location in the physical environment, based on the obtained image data; detecting at least one discontinuity in the physical environment near the at least one location corresponding to the received gesture input data; and generating a digital surface corresponding to a surface in the physical environment, based on the received gesture input data and the at least one discontinuity.

公开(公告)号：US09147221B2

公开(公告)日：2015-09-29

申请号：US13720735

申请日：2012-12-19

Applicant: QUALCOMM INCORPORATED

Inventor： Raphael Grasset ,  Markus Tatzgern ,  Tobias Langlotz ,  Denis Kalkofen ,  Dieter Schmalstieg

IPC: G06T7/00 ,  G06T19/00 ,  G06T1/00 ,  G06T11/00 ,  G06T11/60

CPC classification number: G06T1/00 ,  G06T7/73 ,  G06T11/00 ,  G06T11/60 ,  G06T19/006

Abstract: A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

Abstract translation: 移动设备使用图像驱动视图管理方法来实时注释图像。 由移动设备使用的基于图像的布局处理计算显着图并且从视频流的帧生成边缘图。 可以通过应用阈值来进一步处理显着图，以减少显着性水平的数量。 显着性图和边缘图一起用于确定要在视频流上渲染的标签的布局位置。 标签以布局位置显示，直到检测到相机超过阈值的方向改变为止。 此外，可以例如基于由与视频帧中的标签的布局位置重合的区域限定的多个像素来调整标签的表示。

公开(公告)号：US20130314441A1

公开(公告)日：2013-11-28

申请号：US13720735

申请日：2012-12-19

Applicant: QUALCOMM INCORPORATED

Inventor： Raphael Grasset ,  Markus Tatzgern ,  Tobias Langlotz ,  Denis Kalkofen ,  Dieter Schmalstieg

IPC: G06T1/00

CPC classification number: G06T1/00 ,  G06T7/73 ,  G06T11/00 ,  G06T11/60 ,  G06T19/006

Abstract: A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

Abstract translation: 移动设备使用图像驱动视图管理方法来实时注释图像。 由移动设备使用的基于图像的布局处理计算显着图并且从视频流的帧生成边缘图。 可以通过应用阈值来进一步处理显着图，以减少显着性水平的数量。 显着性图和边缘图一起用于确定要在视频流上渲染的标签的布局位置。 标签以布局位置显示，直到检测到相机超过阈值的方向改变为止。 此外，可以例如基于由与视频帧中的标签的布局位置重合的区域限定的多个像素来调整标签的表示。