公开(公告)号：US10192279B1

公开(公告)日：2019-01-29

申请号：US12060206

申请日：2008-03-31

申请人： Berna Erol ,  Jonathan J. Hull ,  Hidenobu Kishi ,  Qifa Ke ,  Jorge Moraleda

发明人： Berna Erol ,  Jonathan J. Hull ,  Hidenobu Kishi ,  Qifa Ke ,  Jorge Moraleda

IPC分类号： G06Q99/00

摘要： A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides systems, methods, and computer program products for modifying documents for shared use, and for collaborative discussion of shared documents. Captured digital images of documents or portions associated with a user are received, along with modifications to the images. Documents are recognized from the captured digital images, and the modifications to the images are applied to the documents. Alternatively, captured digital images of documents are received, and the documents are recognized along with a hotspot in the document. The user is authenticated to a website associated with the hotspot, and is provided access to an associated multimedia repository.

公开(公告)号：US09530050B1

公开(公告)日：2016-12-27

申请号：US12060198

申请日：2008-03-31

申请人： Berna Erol ,  Jonathan J. Hull ,  Hidenobu Kishi ,  Qifa Le ,  Jorge Moraleda

发明人： Berna Erol ,  Jonathan J. Hull ,  Hidenobu Kishi ,  Qifa Le ,  Jorge Moraleda

IPC分类号： G06K9/00 ,  G06F17/30

CPC分类号： G06K9/00442 ,  G06F17/241 ,  G06F17/30011 ,  G06F17/30047 ,  G06F17/30247

摘要： A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides a system, method, and computer program product for annotating unindexed documents. Captured digital images of unknown paper documents or portions associated with a user are received with annotations. Features are extracted from the captured digital image and are stored, along with the captured digital image and the annotations.

摘要翻译： 公开了混合媒体现实（MMR）系统及其相关技术。 MMR系统提供用于形成包括至少两种类型的媒体（例如，作为第一媒体的打印纸和作为第二媒体的数字内容和/或web链接）的混合媒体文档的机制。 本发明提供了一种用于注释无索引文档的系统，方法和计算机程序产品。 收到未知纸质文档或与用户相关联的部分的数字图像，并附有注释。 从捕获的数字图像中提取特征，并与捕获的数字图像和注释一起存储特征。

公开(公告)号：US09384619B2

公开(公告)日：2016-07-05

申请号：US11461109

申请日：2006-07-31

申请人： Berna Erol ,  Jonathan J. Hull

发明人： Berna Erol ,  Jonathan J. Hull

IPC分类号： G06F17/30 ,  G06K9/00 ,  G07F7/12 ,  G06K9/20 ,  G06K9/62 ,  G07F7/08 ,  G07F7/10 ,  G06F17/00

CPC分类号： G07F7/127 ,  G06K9/00221 ,  G06K9/2054 ,  G06K9/629 ,  G06K2009/00328 ,  G07F7/08 ,  G07F7/1008

摘要： Techniques for automatically comparing one or more objects determined from digital media content (e.g., an image, audio information, video information) to one or more objects specified by a machine readable identifier to determine if an object determined from the media content matches an object specified by the machine readable identifier. One or more actions may be initiated upon determining that an object determined from the media content matches an object specified by the machine readable identifier. Information identifying the action to be initiated may also be encapsulated by the machine readable identifier.

摘要翻译： 用于将从数字媒体内容（例如，图像，音频信息，视频信息）确定的一个或多个对象自动比较到由机器可读标识符指定的一个或多个对象以确定从媒体内容确定的对象是否与指定的对象匹配的技术 通过机器可读标识符。 在确定从媒体内容确定的对象与由机器可读标识符指定的对象匹配时，可以启动一个或多个动作。 识别要启动的动作的信息也可以由机器可读标识符来封装。

公开(公告)号：US09063952B2

公开(公告)日：2015-06-23

申请号：US12247205

申请日：2008-10-07

申请人： Jorge Moraleda ,  Berna Erol ,  Jonathan J. Hull

发明人： Jorge Moraleda ,  Berna Erol ,  Jonathan J. Hull

IPC分类号： G06F17/30 ,  G06K9/00 ,  G06K9/22 ,  G06K9/32 ,  G06K9/20

CPC分类号： G06T11/60 ,  G06F17/30247 ,  G06F17/30256 ,  G06K9/00463 ,  G06K9/228 ,  G06K9/32 ,  G06K9/6288 ,  G06K2009/2045 ,  G06T3/4053

摘要： An MMR system integrating image tracking and recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. Image tracking information also is provided for determining relative locations of images within a document page. The mobile device includes an image tracker for providing at least a portion of the image tracking information. The present invention also includes methods for image tracking-assisted recognition, recognition of multiple images using a single image query, and improved image tracking using MMR recognition.

摘要翻译： 集成图像跟踪和识别的MMR系统包括多个移动设备，预处理服务器或MMR网关和MMR匹配单元，并且可以包括MMR发布者。 MMR匹配单元从预处理服务器或MMR网关接收图像查询，并将其发送到一个或多个识别单元，以识别包括文档，页面和页面上的位置的结果。 还提供图像跟踪信息以确定文档页面内的图像的相对位置。 移动设备包括用于提供图像跟踪信息的至少一部分的图像跟踪器。 本发明还包括用于图像跟踪辅助识别，使用单个图像查询识别多个图像以及使用MMR识别的改进的图像跟踪的方法。

公开(公告)号：US08838591B2

公开(公告)日：2014-09-16

申请号：US11461037

申请日：2006-07-31

申请人： Jonathan J. Hull ,  Berna Erol ,  Jamey Graham ,  Daniel G. Van Olst

发明人： Jonathan J. Hull ,  Berna Erol ,  Jamey Graham ,  Daniel G. Van Olst

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/211 ,  G06F17/30047

摘要： A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system includes a method, system, and computer readable medium for embedding a hot spot in an electronic document. Marks corresponding to a designation for a hot spot in an electronic document are embedded, allowing for later capture of coordinates corresponding to a printed representation of the electronic document and the hot spot.

摘要翻译： 公开了混合媒体现实（MMR）系统及其相关技术。 MMR系统提供用于形成包括至少两种类型的媒体（例如，作为第一媒体的打印纸和作为第二媒体的数字内容和/或web链接）的混合媒体文档的机制。 在一个具体实施例中，MMR系统包括用于将热点嵌入电子文档中的方法，系统和计算机可读介质。 嵌入与电子文档中的热点的指定对应的标记，以便稍后捕获与电子文档和热点的打印表示相对应的坐标。

公开(公告)号：US08584042B2

公开(公告)日：2013-11-12

申请号：US11689401

申请日：2007-03-21

申请人： Berna Erol ,  Kathrin Berkner ,  Jonathan J. Hull ,  Peter E. Hart

发明人： Berna Erol ,  Kathrin Berkner ,  Jonathan J. Hull ,  Peter E. Hart

IPC分类号： G06F3/048

CPC分类号： G10L13/00

摘要： A method, apparatus and article of manufacture for creating visualizations of documents are described. In one embodiment, the method comprises receiving an electronic visual, audio, or audiovisual content; generating a display for authoring a multimedia representation of the received electronic content; receiving user input, if any, through the generated display; and generating a multimedia representation of the received electronic content utilizing received user input.

摘要翻译： 描述了用于创建文件的可视化的方法，装置和制品。 在一个实施例中，该方法包括接收电子视觉，音频或视听内容; 生成用于创建所接收的电子内容的多媒体表示的显示器; 通过生成的显示接收用户输入（如果有的话） 以及利用接收的用户输入生成所接收的电子内容的多媒体表示。

公开(公告)号：US08385589B2

公开(公告)日：2013-02-26

申请号：US12121275

申请日：2008-05-15

申请人： Berna Erol ,  Jonathan J. Hull

发明人： Berna Erol ,  Jonathan J. Hull

IPC分类号： G06K9/00

CPC分类号： G06F17/30253 ,  G06K9/00456

摘要： A web-based image detection system includes: an image capture device, a web browser, a plug-in, and a recognition server. A captured image is processed by the plug-in to assess whether a pre-determined content type is contained with in the image. Once an initial analysis at the browser plug-in detects a pre-determined content type in an image, the image is transmitted to a recognition server for content recognition of the image by content type. The system thus enables users to link documents or other image types to electronic data using only a capture device and a web browser.

摘要翻译： 基于网络的图像检测系统包括：图像捕获装置，网络浏览器，插件和识别服务器。 捕获的图像由插件处理以评估图像中是否包含预定内容类型。 一旦浏览器插件的初步分析检测到图像中的预定内容类型，则图像被发送到识别服务器，以通过内容类型对图像进行内容识别。 因此，该系统使得用户仅使用捕获设备和网络浏览器将文档或其他图像类型链接到电子数据。

公开(公告)号：US08373905B2

公开(公告)日：2013-02-12

申请号：US12334303

申请日：2008-12-12

申请人： Berna Erol ,  Jonathan J. Hull ,  Dar-Shyang Lee ,  Gregory J. Wolff

发明人： Berna Erol ,  Jonathan J. Hull ,  Dar-Shyang Lee ,  Gregory J. Wolff

IPC分类号： G06F3/12 ,  G06F15/00

CPC分类号： G06K9/00442 ,  G06K9/325 ,  G06K9/38 ,  G06K2209/01 ,  G06T5/00

摘要： A printing system enables the printing of enhanced documents using a semantic classification scheme. A printing system receives an image to be printed. The system classifies the image according to the semantic classification scheme and, based on this classification, performs enhancement processing on the image. Depending on the desired application, the printing system may recognize and classify any number of image types and may then perform various enhancement processing functions on the image, where the type of enhancement processing performed is based on the classification of the image.

公开(公告)号：US07991778B2

公开(公告)日：2011-08-02

申请号：US11461024

申请日：2006-07-31

申请人： Jonathan J. Hull ,  Berna Erol ,  Jamey Graham ,  Peter E. Hart ,  Dar-Shyang Lee ,  Kurt Piersol

发明人： Jonathan J. Hull ,  Berna Erol ,  Jamey Graham ,  Peter E. Hart ,  Dar-Shyang Lee ,  Kurt Piersol

IPC分类号： G06F17/30

CPC分类号： G06K9/00442 ,  H04N1/32133 ,  H04N2201/3226 ,  H04N2201/3249 ,  H04N2201/3269

摘要： A Mixed Media Reality (MMR) system and associated techniques provide mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The MMR system includes an action processor and methods, and an MMR document with having an associated action. The MMR document specifies different actions for different MMR documents, and creates any number of MMR documents for a particular location on any media, thereby allowing the MMR architecture to serve as a universal trigger or initiator for additional processing. The action processor receives the output of the MMR recognition process which yields an MMR document including at least one action. The action processor executes that action which includes various commands to the MMR system or other systems coupled to the MMR system. The MMR system architecture can perform action such as retrieving the electronic form of the document to the capture device, retrieving the specification for the action, inserting data to a MMR document, transferring data between documents, purchasing items, authoring actions or reviewing historical information about actions.

摘要翻译： 混合媒体现实（MMR）系统和相关技术提供了用于形成包括至少两种类型（例如作为第一媒体的打印纸和作为第二媒体的数字内容和/或网络链接的打印纸）的混合媒体文档的机制。 MMR系统包括动作处理器和方法以及具有相关动作的MMR文档。 MMR文档为不同的MMR文档规定了不同的操作，并为任何媒体上的特定位置创建了任意数量的MMR文档，从而允许MMR架构作为通用触发器或启动器进行额外处理。 动作处理器接收MMR识别过程的输出，其产生包括至少一个动作的MMR文档。 动作处理器执行包括各种命令到MMR系统或耦合到MMR系统的其他系统的动作。 MMR系统架构可以执行诸如将文档的电子表单检索到捕获设备，检索操作的规范，将数据插入MMR文档，在文档之间传送数据，购买项目，创作动作或者查看关于 行动。

公开(公告)号：US07639387B2

公开(公告)日：2009-12-29

申请号：US11461268

申请日：2006-07-31

申请人： Jonathan J. Hull ,  Berna Erol ,  Jamey Graham ,  Peter E. Hart ,  Kurt Piersol

发明人： Jonathan J. Hull ,  Berna Erol ,  Jamey Graham ,  Peter E. Hart ,  Kurt Piersol

IPC分类号： G06K15/02 ,  H04N1/04

CPC分类号： G06K9/00442

摘要： A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system provides a method to associate related documents. The method acquires two associated documents and associates the related portions together. When the method acquires a portion of one of the document, it identifies the portion acquired, and provides the related portion of the other document.

摘要翻译： 公开了混合媒体现实（MMR）系统及其相关技术。 MMR系统提供用于形成包括至少两种类型的媒体（例如，作为第一媒体的打印纸和作为第二媒体的数字内容和/或web链接）的混合媒体文档的机制。 在一个特定实施例中，MMR系统提供了一种关联相关文档的方法。 该方法获取两个相关联的文档并将相关部分相关联。 当方法获取文档中的一个的一部分时，它识别所获取的部分，并提供其他文档的相关部分。