公开(公告)号：US20190073386A1

公开(公告)日：2019-03-07

申请号：US16181175

申请日：2018-11-05

Applicant: QUALCOMM Incorporated

Inventor： Md Sazzadur RAHMAN ,  Kexi LIU ,  Martin RENSCHLER

IPC: G06F17/30 ,  G06T19/00 ,  G02B27/01 ,  G06F3/01

CPC classification number: G06F16/532 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/013 ,  G06F3/017 ,  G06F16/332 ,  G06F16/583 ,  G06F16/951 ,  G06F16/9554 ,  G06T19/006

Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.

公开(公告)号：US20150049013A1

公开(公告)日：2015-02-19

申请号：US14162727

申请日：2014-01-23

Applicant: QUALCOMM Incorporated

Inventor： Md Sazzadur RAHMAN ,  Kexi LIU ,  Martin H. RENSCHLER

IPC: G06F3/01 ,  G06T19/00 ,  G02B27/01

CPC classification number: G06F3/013 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/016 ,  G06F3/0304 ,  G06T19/006

Abstract: An apparatus for calibrating an eye tracking system of a head mounted display displays a moving object in a scene visible through the head mounted display. The object is displayed progressively at a plurality of different points (P) at corresponding different times (T). While the object is at a first point of the plurality of different points in time, the apparatus determines whether an offset between the point P and an eye gaze point (E) satisfies a threshold. The eye-gaze point (E) corresponds to a point where a user is determined to be gazing by the eye tracking system. If the threshold is not satisfied, the apparatus performs a calibration of the eye tracking system when the object is at a second point of the plurality of different points in time. The apparatus then repeats the determining step when the object is at a third point of the plurality of different points in time.

Abstract translation: 用于校准头戴式显示器的眼睛跟踪系统的装置通过头戴式显示器在可见的场景中显示移动物体。 物体在相应的不同时间（T）处的多个不同点（P）逐渐显示。 当物体处于多个不同时间点的第一点时，该装置确定点P和眼睛凝视点（E）之间的偏移是否满足阈值。 眼睛注视点（E）对应于用户被眼睛跟踪系统凝视的点。 如果不满足阈值，则当物体处于多个不同时间点的第二点时，该装置执行眼睛跟踪系统的校准。 然后，当物体处于多个不同时间点的第三点时，该装置重复确定步骤。

公开(公告)号：US20150049001A1

公开(公告)日：2015-02-19

申请号：US14151546

申请日：2014-01-09

Applicant: QUALCOMM Incorporated

Inventor： Md Sazzadur RAHMAN ,  Martin H. RENSCHLER ,  Kexi LIU

IPC: G02B27/01

CPC classification number: G02B27/017 ,  G06F3/1454 ,  G09G2340/0464 ,  G09G2340/14 ,  G09G2354/00 ,  H04N13/344 ,  H04N13/383

Abstract: A method, an apparatus, and a computer program product construct an augmented view as perceived by a user of an augmented reality (AR) device having an optical see-through head mounted display (HMD) with AR, for display at a remote device. An apparatus obtains scene data corresponding to a real-world scene visible through the optical see-through HMD, and screen data of at least one of a first augmented object displayed on the optical see-through HMD, and a second augmented object displayed on the optical see-through HMD. The apparatus determines to apply at least one of a first offset to the first augmented object relative to an origin of the real-world scene, and a second offset to the second augmented object relative to the origin. The apparatus then generates augmented-view screen data for displaying the augmented view on an HMD remote from the AR device. The augmented-view screen data is based on at least one of the first offset and the second offset.

Abstract translation: 一种方法，装置和计算机程序产品构成由具有AR的光学透视头安装显示器（HMD）的增强现实（AR）设备的用户感觉到的增强视图，用于在远程设备处显示。 一种装置获得与通过光学透视HMD可见的真实场景相对应的场景数据，以及在光学透视HMD上显示的第一增强对象中的至少一个的屏幕数据和显示在光学透视HMD上的第二增强对象 光学透视HMD。 设备确定相对于真实世界场景的原点将第一偏移量的第一偏移中的至少一个应用于第一增强对象，以及相对于原点向第二增强对象施加第二偏移。 然后，该装置生成用于在从AR设备的HMD远程上显示增强视图的增强视图屏幕数据。 增强视图屏幕数据基于第一偏移和第二偏移中的至少一个。