公开(公告)号：US20150262428A1

公开(公告)日：2015-09-17

申请号：US14640981

申请日：2015-03-06

Applicant: QUALCOMM Incorporated

Inventor： Markus Tatzgern ,  Denis Kalkofen ,  Dieter Schmalstieg ,  Raphael David Andre Grasset

IPC: G06T19/00 ,  G06T7/00 ,  G06T17/00

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/017 ,  G06F3/147 ,  G06K9/00671 ,  G06T11/00 ,  G06T2210/61

Abstract: Methods, systems, computer-readable media, and apparatuses for hierarchical clustering for view management in augmented reality are presented. For example one disclosed method includes the steps of accessing point of interest (POI) metadata for a plurality of points of interest associated with a scene; generating a hierarchical cluster tree for at least a portion of the POIs; establishing a plurality of subdivisions associated with the scene; selecting a plurality of POIs from the hierarchical cluster tree for display based on an augmented reality (AR) viewpoint of the scene, the plurality of subdivisions, and a traversal of at least a portion of the hierarchical cluster tree; and displaying labels comprising POI metadata associated with the selected plurality of POIs, the displaying based on placements determined using image-based saliency.

Abstract translation: 提出了用于增强现实中的视图管理的层次聚类的方法，系统，计算机可读介质和装置。 例如，一种公开的方法包括以下步骤：为与场景相关联的多个感兴趣点访问兴趣点（POI）元数据; 为所述POI的至少一部分生成分层聚簇树; 建立与场景相关联的多个细分; 基于所述场景的增强现实（AR）视点，所述多个子部分以及所述分层聚簇树的至少一部分的遍历来从所述分层聚簇树中选择多个POI以进行显示; 以及显示包括与所选择的多个POI相关联的POI元数据的标签，基于使用基于图像的显着性确定的布局进行显示。

公开(公告)号：US20150262380A1

公开(公告)日：2015-09-17

申请号：US14658108

申请日：2015-03-13

Applicant: QUALCOMM INCORPORATED

Inventor： Philipp Grasmug ,  Dieter Schmalstieg ,  Stefan Hauswiesner ,  Denis Kalkofen

IPC: G06T7/20 ,  G06T19/00

CPC classification number: G06T19/006 ,  G06T3/40 ,  G06T7/20 ,  G06T7/207 ,  G06T7/292 ,  G06T2207/10016 ,  G06T2207/20004 ,  G06T2207/20016 ,  G06T2207/30244

Abstract: A method, device, and apparatus for determining optical flow from a plurality of images is described and includes receiving a first image frame from a first plurality of images, where the first plurality of images have a first resolution and a first frame rate. A second image frame may be received from a second plurality of images, where the second plurality of images have a second resolution less than the first resolution and a second frame rate greater than the first frame rate. A first optical flow may be computed from the first image frame to the second image frame. Additionally, the based at least in part on the first optical flow from the first image frame to the second image frame, a third image frame may be output as part of an output stream. The output stream may have a frame rate greater than or equal to the first frame rate, where the third image frame has a resolution greater than or equal to the second resolution.

Abstract translation: 描述了用于从多个图像确定光流的方法，装置和装置，并且包括从第一多个图像接收第一图像帧，其中第一多个图像具有第一分辨率和第一帧速率。 可以从第二多个图像接收第二图像帧，其中第二多个图像具有小于第一分辨率的第二分辨率和大于第一帧速率的第二帧速率。 可以从第一图像帧到第二图像帧计算第一光流。 另外，至少部分地基于从第一图像帧到第二图像帧的第一光流，第三图像帧可以作为输出流的一部分被输出。 输出流可以具有大于或等于第一帧速率的帧速率，其中第三图像帧具有大于或等于第二分辨率的分辨率。

公开(公告)号：US09147221B2

公开(公告)日：2015-09-29

申请号：US13720735

申请日：2012-12-19

Applicant: QUALCOMM INCORPORATED

Inventor： Raphael Grasset ,  Markus Tatzgern ,  Tobias Langlotz ,  Denis Kalkofen ,  Dieter Schmalstieg

IPC: G06T7/00 ,  G06T19/00 ,  G06T1/00 ,  G06T11/00 ,  G06T11/60

CPC classification number: G06T1/00 ,  G06T7/73 ,  G06T11/00 ,  G06T11/60 ,  G06T19/006

Abstract: A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

Abstract translation: 移动设备使用图像驱动视图管理方法来实时注释图像。 由移动设备使用的基于图像的布局处理计算显着图并且从视频流的帧生成边缘图。 可以通过应用阈值来进一步处理显着图，以减少显着性水平的数量。 显着性图和边缘图一起用于确定要在视频流上渲染的标签的布局位置。 标签以布局位置显示，直到检测到相机超过阈值的方向改变为止。 此外，可以例如基于由与视频帧中的标签的布局位置重合的区域限定的多个像素来调整标签的表示。

公开(公告)号：US20130314441A1

公开(公告)日：2013-11-28

申请号：US13720735

申请日：2012-12-19

Applicant: QUALCOMM INCORPORATED

Inventor： Raphael Grasset ,  Markus Tatzgern ,  Tobias Langlotz ,  Denis Kalkofen ,  Dieter Schmalstieg

IPC: G06T1/00

CPC classification number: G06T1/00 ,  G06T7/73 ,  G06T11/00 ,  G06T11/60 ,  G06T19/006

Abstract: A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

Abstract translation: 移动设备使用图像驱动视图管理方法来实时注释图像。 由移动设备使用的基于图像的布局处理计算显着图并且从视频流的帧生成边缘图。 可以通过应用阈值来进一步处理显着图，以减少显着性水平的数量。 显着性图和边缘图一起用于确定要在视频流上渲染的标签的布局位置。 标签以布局位置显示，直到检测到相机超过阈值的方向改变为止。 此外，可以例如基于由与视频帧中的标签的布局位置重合的区域限定的多个像素来调整标签的表示。