Invention Grant
- Patent Title: Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking
-
Application No.: US16181175Application Date: 2018-11-05
-
Publication No.: US10372751B2Publication Date: 2019-08-06
- Inventor: Md Sazzadur Rahman , Kexi Liu , Martin Renschler
- Applicant: QUALCOMM Incorporated
- Applicant Address: US CA San Diego
- Assignee: QUALCOMM Incorporated
- Current Assignee: QUALCOMM Incorporated
- Current Assignee Address: US CA San Diego
- Agency: Polsinelli LLP
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G02B27/01 ; G06T19/00 ; G06F16/532 ; G06F16/332 ; G06F16/583 ; G06F16/951 ; G06F16/955

Abstract:
A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
Public/Granted literature
Information query