Adaptive fiducials for image match recognition and tracking

    公开(公告)号:US10147399B1

    公开(公告)日:2018-12-04

    申请号:US14475333

    申请日:2014-09-02

    Applicant: A9.com, Inc.

    Abstract: Approaches enable images submitted by users, owner, and/or authorized person of a point of interest (e.g., a place, a scene, an object, etc.) to be used as a fiducial to assist recognition and tracking of the point of interest in an augmented reality environment. Multiple images (e.g., crowd-sourced images) of a point of interest taken from different points of view can be dynamically used. For example, as a user with a user device moves through a point of interest, a different image can be chosen from a set of stored candidate images of the point of interest based at least upon GPS locations, IMU orientations, or compass data of the user device. In this way, instead of relying on artificial fiducial images for various detection and tracking approaches, approaches enable images submitted by users and/or an owner or other authorized person of a point of interest to be used as fiducials to assist recognition and tracking of the point of interest.

    Sharing links in an augmented reality environment
    4.
    发明授权
    Sharing links in an augmented reality environment 有权
    在增强的现实环境中共享链接

    公开(公告)号:US09432421B1

    公开(公告)日:2016-08-30

    申请号:US14229678

    申请日:2014-03-28

    Applicant: A9.com, Inc.

    Abstract: Various embodiments provide methods and systems for users and business owners to share content and/or links to visual elements of a place at a physical location, and, in response to a user device pointing at a tagged place, causing the content and/or links to the visual elements of the place to be presented on the user device. In some embodiments, content and links are tied to specific objects at a place based at least in part upon one of Global Positioning System (GPS) locations, Inertial Measurement Unit (IMU) orientations, compass data, or one or more visual matching algorithms. Once the content and links are attached to the specific objects of the place, they can be discovered by a user with a portable device pointing at the specific objects in the real world.

    Abstract translation: 各种实施例提供了用于用户和企业所有者分享内容和/或链接到物理位置处的场所的视觉元素的方法和系统,并且响应于用户设备指向标记的地点,导致内容和/或链接 到在用户设备上呈现的地方的视觉元素。 在一些实施例中,内容和链接至少部分地基于全球定位系统(GPS)位置之一,惯性测量单元(IMU)取向,罗盘数据或一个或多个视觉匹配算法来连接到某个地点的特定对象。 一旦将内容和链接附加到该地点的特定对象,用户可以通过指向现实世界中特定对象的便携式设备发现它们。

    Visual search suggestions
    5.
    发明授权

    公开(公告)号:US10540378B1

    公开(公告)日:2020-01-21

    申请号:US15195445

    申请日:2016-06-28

    Applicant: A9.com, Inc.

    Abstract: Approaches provide for analyzing image data to determine and/or recognize text in the image data. The recognized text can be used to generate a search query that can be automatically submitted to a search engine without having to type the search query to identify a product (or related products) associated with the image. For example, a camera of a computing device can be used to capture a live camera view (or single images) an item. An application executing on the computing device (or at least in communication with the computing device) can analyze the image data of the live camera view to determine a set of keywords (e.g., identified text) based on visual features extracted from the image data. The keywords can be used to query an index of product titles, common search queries, among other indexed data to return a ranked list of search suggestions based on a relevance function. The relevance function can consider the ordering of the keywords to rank search suggestions more highly that contain the keywords having the same word order. Further, the relevance function can consider the confidence of the visual recognition of each keyword, the confidence of each search suggestion, customer impact, as well as other factors to determine the ranking of the search suggestions. The search suggestions can be further refined to ensure search results that the user will be more likely to view and/or purchase.

    Advertisement relevance
    7.
    发明授权
    Advertisement relevance 有权
    广告相关性

    公开(公告)号:US09552674B1

    公开(公告)日:2017-01-24

    申请号:US14226533

    申请日:2014-03-26

    Applicant: A9.com, Inc.

    Abstract: Systems and methods for displaying an image of a virtual object in an environment are described. A computing device is used to capture an image of a real environment including a marker. One or more virtual objects which do not exist in the real environment are displayed in the image based at least on the marker. The distance and orientation of the marker may be taken into account to properly size and place the virtual object in the image. Further, virtual lighting may be added to an image to indicate to a user how the virtual object would appear with the virtual lighting.

    Abstract translation: 描述用于在环境中显示虚拟对象的图像的系统和方法。 计算设备用于捕获包括标记的真实环境的图像。 至少在标记上,在图像中显示在真实环境中不存在的一个或多个虚拟对象。 可以考虑标记的距离和方向以适当地大小并将虚拟对象放置在图像中。 此外,可以向图像添加虚拟照明,以向用户指示虚拟对象将如何与虚拟照明一起出现。

    Fast interest point extraction for augmented reality
    8.
    发明授权
    Fast interest point extraction for augmented reality 有权
    用于增强现实的快速兴趣点提取

    公开(公告)号:US09524432B1

    公开(公告)日:2016-12-20

    申请号:US14313466

    申请日:2014-06-24

    Applicant: A9.com, Inc.

    Abstract: The subject technology provides embodiments for performing fast corner detection in a given image for augmented reality applications. Embodiments disclose a high-speed test that examines intensities of pairs of pixels around a candidate center pixel. In one example, the examined pairs are comprised of pixels that are diametrically opposite ends of a circle formed with the candidate center pixel. Further, a pyramid of images including four rings of surrounding pixels is generated. An orientation of the pixels from the four rings are determined and a vector of discrete values of the pixels are provided. Next, a forest of trees are generated for the vector of discrete values corresponding to a descriptor for a first image. For a second image including a set of descriptors, approximate nearest neighbors are determined from the forest of tree representing closest matching descriptors from the first image.

    Abstract translation: 主题技术提供了用于在用于增强现实应用的给定图像中执行快速拐角检测的实施例。 实施例公开了一种高速测试,其检查候选中心像素周围的像素对的强度。 在一个示例中,所检查的对由包括与候选中心像素形成的圆的直径相对的两端的像素组成。 此外,生成包括四个周围像素环的图像的金字塔。 确定来自四个环的像素的取向,并且提供像素的离散值的矢量。 接下来,对于与第一图像的描述符相对应的离散值的矢量,生成树林。 对于包括一组描述符的第二图像,从表示来自第一图像的最近匹配描述符的树的森林确定近似最近邻居。

    FAST INTEREST POINT EXTRACTION FOR AUGMENTED REALITY

    公开(公告)号:US20170154244A1

    公开(公告)日:2017-06-01

    申请号:US15381463

    申请日:2016-12-16

    Applicant: A9.com, Inc.

    Abstract: The subject technology provides embodiments for performing fast corner detection in a given image for augmented reality applications. Embodiments disclose a high-speed test that examines intensities of pairs of pixels around a candidate center pixel. In one example, the examined pairs are comprised of pixels that are diametrically opposite ends of a circle formed with the candidate center pixel. Further, a pyramid of images including four rings of surrounding pixels is generated. An orientation of the pixels from the four rings are determined and a vector of discrete values of the pixels are provided. Next, a forest of trees are generated for the vector of discrete values corresponding to a descriptor for a first image. For a second image including a set of descriptors, approximate nearest neighbors are determined from the forest of tree representing closest matching descriptors from the first image.

Patent Agency Ranking