Indexed document modification sharing with mixed media reality

    公开(公告)号:US10192279B1

    公开(公告)日:2019-01-29

    申请号:US12060206

    申请日:2008-03-31

    IPC分类号: G06Q99/00

    摘要: A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides systems, methods, and computer program products for modifying documents for shared use, and for collaborative discussion of shared documents. Captured digital images of documents or portions associated with a user are received, along with modifications to the images. Documents are recognized from the captured digital images, and the modifications to the images are applied to the documents. Alternatively, captured digital images of documents are received, and the documents are recognized along with a hotspot in the document. The user is authenticated to a website associated with the hotspot, and is provided access to an associated multimedia repository.

    Document annotation sharing
    2.
    发明授权
    Document annotation sharing 有权
    文件注释共享

    公开(公告)号:US09530050B1

    公开(公告)日:2016-12-27

    申请号:US12060198

    申请日:2008-03-31

    IPC分类号: G06K9/00 G06F17/30

    摘要: A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides a system, method, and computer program product for annotating unindexed documents. Captured digital images of unknown paper documents or portions associated with a user are received with annotations. Features are extracted from the captured digital image and are stored, along with the captured digital image and the annotations.

    摘要翻译: 公开了混合媒体现实(MMR)系统及其相关技术。 MMR系统提供用于形成包括至少两种类型的媒体(例如,作为第一媒体的打印纸和作为第二媒体的数字内容和/或web链接)的混合媒体文档的机制。 本发明提供了一种用于注释无索引文档的系统,方法和计算机程序产品。 收到未知纸质文档或与用户相关联的部分的数字图像,并附有注释。 从捕获的数字图像中提取特征,并与捕获的数字图像和注释一起存储特征。

    Mixed media reality recognition with image tracking
    3.
    发明授权
    Mixed media reality recognition with image tracking 有权
    混合媒体现实识别与图像跟踪

    公开(公告)号:US09063952B2

    公开(公告)日:2015-06-23

    申请号:US12247205

    申请日:2008-10-07

    摘要: An MMR system integrating image tracking and recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. Image tracking information also is provided for determining relative locations of images within a document page. The mobile device includes an image tracker for providing at least a portion of the image tracking information. The present invention also includes methods for image tracking-assisted recognition, recognition of multiple images using a single image query, and improved image tracking using MMR recognition.

    摘要翻译: 集成图像跟踪和识别的MMR系统包括多个移动设备,预处理服务器或MMR网关和MMR匹配单元,并且可以包括MMR发布者。 MMR匹配单元从预处理服务器或MMR网关接收图像查询,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 还提供图像跟踪信息以确定文档页面内的图像的相对位置。 移动设备包括用于提供图像跟踪信息的至少一部分的图像跟踪器。 本发明还包括用于图像跟踪辅助识别,使用单个图像查询识别多个图像以及使用MMR识别的改进的图像跟踪的方法。

    Mixed Media Reality Recognition With Image Tracking
    4.
    发明申请
    Mixed Media Reality Recognition With Image Tracking 有权
    混合媒体现实识别与图像跟踪

    公开(公告)号:US20090092287A1

    公开(公告)日:2009-04-09

    申请号:US12247205

    申请日:2008-10-07

    IPC分类号: G06K9/00

    摘要: An MMR system integrating image tracking and recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. Image tracking information also is provided for determining relative locations of images within a document page. The mobile device includes an image tracker for providing at least a portion of the image tracking information. The present invention also includes methods for image tracking-assisted recognition, recognition of multiple images using a single image query, and improved image tracking using MMR recognition.

    摘要翻译: 集成图像跟踪和识别的MMR系统包括多个移动设备,预处理服务器或MMR网关和MMR匹配单元,并且可以包括MMR发布者。 MMR匹配单元从预处理服务器或MMR网关接收图像查询,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 还提供图像跟踪信息以确定文档页面内的图像的相对位置。 移动设备包括用于提供图像跟踪信息的至少一部分的图像跟踪器。 本发明还包括用于图像跟踪辅助识别,使用单个图像查询识别多个图像以及使用MMR识别的改进的图像跟踪的方法。

    Multiple Index Mixed Media Reality Recognition Using Unequal Priority Indexes
    5.
    发明申请
    Multiple Index Mixed Media Reality Recognition Using Unequal Priority Indexes 有权
    使用不等优先级索引的多重索引混合媒体现实识别

    公开(公告)号:US20090080800A1

    公开(公告)日:2009-03-26

    申请号:US12240596

    申请日:2008-09-29

    IPC分类号: G06K9/36

    摘要: An MMR system for processing image queries across index tables with unequal priority comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. The MMR matching unit includes a dispatcher, a plurality of recognition units, and index tables, as well as an image registration unit. In one embodiment, the system includes an MMR matching plug-in installed on the mobile device. The present invention also includes methods for processing image queries across index tables of unequal priority and updating a high priority index based on received or projected image queries.

    摘要翻译: 用于处理具有不等优先级的索引表的图像查询的MMR系统包括多个移动设备,预处理服务器或MMR网关以及MMR匹配单元,并且可以包括MMR发布者。 MMR匹配单元从预处理服务器或MMR网关接收图像查询,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 MMR匹配单元包括调度器,多个识别单元和索引表,以及图像配准单元。 在一个实施例中,系统包括安装在移动设备上的MMR匹配插件。 本发明还包括用于处理跨越不等优先级的索引表的图像查询的方法,并且基于接收或投影的图像查询更新高优先级索引。

    COMBINING RESULTS OF IMAGE RETRIEVAL PROCESSES
    6.
    发明申请
    COMBINING RESULTS OF IMAGE RETRIEVAL PROCESSES 有权
    图像检索过程的组合结果

    公开(公告)号:US20090070110A1

    公开(公告)日:2009-03-12

    申请号:US12210540

    申请日:2008-09-15

    IPC分类号: G10L15/00

    摘要: A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR matching unit also includes a result combiner coupled to each of the recognition units to receive recognition results. The result combiner produces a list of most likely results and associated confidence scores. This list of results is sent by the result combiner back to the MMR gateway for presentation on the mobile device. The result combiner uses the quality predictor as an input in deciding which results are best. The present invention also includes a number of novel methods including a method for generating the list of best results.

    摘要翻译: 用于报纸出版的MMR系统包括多个移动设备,MMR网关,MMR匹配单元和MMR发布者。 MMR匹配单元从MMR网关接收图像查询,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 MMR匹配单元还包括耦合到每个识别单元以接收识别结果的结果组合器。 结果组合器产生最可能的结果和相关置信得分的列表。 该结果列表由结果组合器发送回MMR网关以在移动设备上呈现。 结果组合器使用质量预测器作为输入来决定哪些结果是最佳的。 本发明还包括许多新颖的方法,包括用于产生最佳结果列表的方法。

    Mixed Media Reality Recognition Using Multiple Specialized Indexes
    7.
    发明申请
    Mixed Media Reality Recognition Using Multiple Specialized Indexes 有权
    使用多个专业指标的混合媒体现实识别

    公开(公告)号:US20150139540A1

    公开(公告)日:2015-05-21

    申请号:US14604619

    申请日:2015-01-23

    摘要: An MMR system for searching across multiple indexes comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. The MMR matching unit includes a distributor for distributing the image to corresponding content type specific index tables and an integrator for integrating recognition results. The result is returned to the mobile device via the pre-processing server or MMR gateway. The techniques described herein also include a number of novel methods including a method for processing content-type specific image queries and for processing queries across multiple indexes.

    摘要翻译: 用于在多个索引上搜索的MMR系统包括多个移动设备,预处理服务器或MMR网关以及MMR匹配单元,并且可以包括MMR发布者。 MMR匹配单元从预处理服务器或MMR网关接收图像,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 MMR匹配单元包括用于将图像分发到相应的内容类型特定索引表的分发器和用于集成识别结果的积分器。 结果通过预处理服务器或MMR网关返回到移动设备。 本文描述的技术还包括许多新颖的方法,包括用于处理内容类型特定图像查询并且用于跨多个索引处理查询的方法。

    Ad hoc paper-based networking with mixed media reality
    8.
    发明授权
    Ad hoc paper-based networking with mixed media reality 有权
    具有混合媒体现实的特别纸质网络

    公开(公告)号:US08989431B1

    公开(公告)日:2015-03-24

    申请号:US12060200

    申请日:2008-03-31

    IPC分类号: G06K9/00 G06T5/00

    CPC分类号: G06T5/009 G06K9/00442

    摘要: A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides a system, method, and computer program product for creating an ad hoc association between users. Captured digital images of paper documents or portions associated with a user are received. Document recognition features are extracted from the captured digital image. An ad hoc association is created between the user and another user associated with an existing document recognition feature similar to the extracted document recognition features.

    摘要翻译: 公开了混合媒体现实(MMR)系统及其相关技术。 MMR系统提供用于形成包括至少两种类型的媒体(例如,作为第一媒体的打印纸和作为第二媒体的数字内容和/或web链接)的混合媒体文档的机制。 本发明提供了一种用于创建用户之间的临时关联的系统,方法和计算机程序产品。 收到纸张文件或与用户相关的部分的数字图像的捕获。 从捕获的数字图像中提取文档识别特征。 在与所提取的文档识别特征相似的用户与与现有文档识别特征相关联的另一用户之间创建特别关联。

    Computation of a recongnizability score (quality predictor) for image retrieval
    9.
    发明授权
    Computation of a recongnizability score (quality predictor) for image retrieval 有权
    计算图像检索的可信度评分(质量预测值)

    公开(公告)号:US08868555B2

    公开(公告)日:2014-10-21

    申请号:US12210532

    申请日:2008-09-15

    摘要: A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR system also includes a quality predictor as a plug-in installed on the mobile device to filter images before they are included as part of a retrieval request or as part of the MMR matching unit. The quality predictor comprises an input for receiving recognition algorithm information, a vector calculator, a score generator and a scoring module. The quality predictor receives as inputs an image query, context information and device parameters, and generates an outputs a recognizability score. The present invention also includes a method for generating robustness features.

    摘要翻译: 用于报纸出版的MMR系统包括多个移动设备,MMR网关,MMR匹配单元和MMR发布者。 MMR匹配单元从MMR网关接收图像查询,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 MMR系统还包括安装在移动设备上的插件的质量预测器,以在作为检索请求的一部分被包括在内的过滤图像或者作为MMR匹配单元的一部分。 质量预测器包括用于接收识别算法信息的输入,向量计算器,得分生成器和评分模块。 质量预测器作为输入接收图像查询,上下文信息和设备参数,并产生可识别得分的输出。 本发明还包括一种用于产生鲁棒性特征的方法。

    Capturing Symbolic Information From Documents Upon Printing
    10.
    发明申请
    Capturing Symbolic Information From Documents Upon Printing 有权
    从印刷文件中获取符号信息

    公开(公告)号:US20120257237A1

    公开(公告)日:2012-10-11

    申请号:US13494008

    申请日:2012-06-11

    IPC分类号: G06K15/02

    摘要: An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit, and an MMR publisher. A computer includes a document authoring application, plug-in, and printer driver. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a method for capturing symbolic information from documents and for capturing printer dll functions.

    摘要翻译: 用于发布的MMR系统包括多个移动设备,MMR网关,MMR匹配单元和MMR发布者。 计算机包括文档创作应用程序,插件和打印机驱动程序。 MMR匹配单元从MMR网关接收图像查询,并将其发送到一个或多个识别单元,以识别包括文档,页面和页面上的位置的结果。 结果和链接列表将发送回MMR网关,以便在移动设备上进行演示。 本发明还包括许多新颖的方法,包括用于从文档捕获符号信息和捕获打印机dll功能的方法。