公开(公告)号：US07970171B2

公开(公告)日：2011-06-28

申请号：US11624466

申请日：2007-01-18

申请人： Andrew Lookingbill ,  Emilio Antunez ,  Berna Erol ,  Jonathan J. Hull ,  Qifa Ke

发明人： Andrew Lookingbill ,  Emilio Antunez ,  Berna Erol ,  Jonathan J. Hull ,  Qifa Ke

IPC分类号： G06K9/00

CPC分类号： H04N1/107 ,  G06K9/2081 ,  G06K9/228 ,  G06K9/3258 ,  G06K2009/363 ,  G06K2209/01 ,  H04N2201/0414

摘要： A system and a method are disclosed for generating video. Object information is received. A path of motion of the object relative to a reference point is generated. A series of images and ground for a reference frame are generated from the ground truth and the generated path. A system and a method are disclosed for generating an image. Object information is received. Image data and ground truth may be generated using position, the image description, the camera characteristics, and image distortion parameters. A positional relationship between the document and a reference point is determined. An image of the document and ground truth are generated from the object information and the positional relationship and in response to user specified environment of the document.

摘要翻译： 公开了一种用于产生视频的系统和方法。 收到对象信息。 生成对象相对于参考点的运动路径。 从地面真值和生成的路径生成一系列用于参考帧的图像和地面。 公开了一种用于生成图像的系统和方法。 收到对象信息。 可以使用位置，图像描述，相机特性和图像失真参数来生成图像数据和地面真实。 确定文件与参考点之间的位置关系。 从对象信息和位置关系以及响应于用户指定的文档环境生成文档和地面真值的图像。

公开(公告)号：US20090076996A1

公开(公告)日：2009-03-19

申请号：US12247202

申请日：2008-10-07

申请人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

发明人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

IPC分类号： G06N5/02

CPC分类号： G06F17/30247 ,  G06F17/30876 ,  G06K9/00463 ,  G06K9/00993 ,  G06K9/6227 ,  G06K9/6256 ,  G06K9/6262

摘要： A MMR system that uses multiple classifiers for predicting, monitoring, and adjusting index tables for image recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit includes a plurality of recognition unit and index table pairs corresponding to classifiers to be applied to received image queries, as well as an image registration unit for storing and monitoring performance data for the classifiers. The MMR matching unit receives the image query and identifies, using a classifier set, a result including a document, the page, and the location on the page corresponding to the image query. The present invention also includes methods for monitoring online performance of a multiple classifier image recognition system, for classifier selection and comparison, and for offline classifier prediction.

摘要翻译： 使用多个分类器来预测，监视和调整用于图像识别的索引表的MMR系统包括多个移动设备，预处理服务器或MMR网关以及MMR匹配单元，并且可以包括MMR发布者。 MMR匹配单元包括对应于要应用于接收到的图像查询的分类器的多个识别单元和索引表对，以及用于存储和监视分类器的性能数据的图像注册单元。 MMR匹配单元接收图像查询，并使用分类器集合识别包括文档，页面以及与图像查询相对应的页面上的位置的结果。 本发明还包括用于监视多分类器图像识别系统的在线性能，分类器选择和比较以及离线分类器预测的方法。

公开(公告)号：US20080175507A1

公开(公告)日：2008-07-24

申请号：US11624466

申请日：2007-01-18

申请人： Andrew Lookingbill ,  Emilio Antunez ,  Berna Erol ,  Jonathan J. Hull ,  Qifa Ke

发明人： Andrew Lookingbill ,  Emilio Antunez ,  Berna Erol ,  Jonathan J. Hull ,  Qifa Ke

IPC分类号： G06K9/40

CPC分类号： H04N1/107 ,  G06K9/2081 ,  G06K9/228 ,  G06K9/3258 ,  G06K2009/363 ,  G06K2209/01 ,  H04N2201/0414

摘要： A system and a method are disclosed for generating video. Object information is received. A path of motion of the object relative to a reference point is generated. A series of images and ground for a reference frame are generated from the ground truth and the generated path. A system and a method are disclosed for generating an image. Object information is received. Image data and ground truth may be generated using position, the image description, the camera characteristics, and image distortion parameters. A positional relationship between the document and a reference point is determined. An image of the document and ground truth are generated from the object information and the positional relationship and in response to user specified environment of the document.

摘要翻译： 公开了一种用于产生视频的系统和方法。 收到对象信息。 生成对象相对于参考点的运动路径。 从地面真值和生成的路径生成一系列用于参考帧的图像和地面。 公开了一种用于生成图像的系统和方法。 收到对象信息。 可以使用位置，图像描述，相机特性和图像失真参数来生成图像数据和地面真实。 确定文件与参考点之间的位置关系。 从对象信息和位置关系以及响应于用户指定的文档环境生成文档和地面真值的图像。

公开(公告)号：US09972108B2

公开(公告)日：2018-05-15

申请号：US14746669

申请日：2015-06-22

申请人： Jorge Moraleda ,  Berna Erol ,  Jonathan J. Hull

发明人： Jorge Moraleda ,  Berna Erol ,  Jonathan J. Hull

IPC分类号： G06F17/30 ,  G06T11/60 ,  G06K9/00 ,  G06K9/22 ,  G06K9/32 ,  G06K9/62 ,  G06T3/40 ,  G06K9/20

CPC分类号： G06T11/60 ,  G06F17/30247 ,  G06F17/30256 ,  G06K9/00463 ,  G06K9/228 ,  G06K9/32 ,  G06K9/6288 ,  G06K2009/2045 ,  G06T3/4053

摘要： An MMR system integrating image tracking and recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a recognition result. Image tracking information also is provided for determining relative locations of images to each other. The mobile device includes an image tracker for providing at least a portion of the image tracking information. The disclosure also includes methods for image tracking-assisted recognition, recognition of multiple images using a single image query, and improved image tracking using MMR recognition.

公开(公告)号：US09870388B2

公开(公告)日：2018-01-16

申请号：US13914417

申请日：2013-06-10

申请人： Berna Erol ,  Jonathan J. Hull

发明人： Berna Erol ,  Jonathan J. Hull

IPC分类号： G06F17/00 ,  G06F17/30 ,  G06K9/00 ,  G06K9/03 ,  G06K9/22 ,  G06K9/62

CPC分类号： G06F17/30386 ,  G06F17/30247 ,  G06F17/30876 ,  G06K9/00463 ,  G06K9/00979 ,  G06K9/036 ,  G06K9/228 ,  G06K9/6293

摘要： An MMR system includes an analytics module for monitoring and analyzing the creation and usage of visual content search. The analytics module is part of an MMR gateway and provides a mechanism for administrators to determine the usage patterns and other information about users of the MMR system. The analytics module comprises a monitoring module, a usage database, an access analysis module and a presentation module. The monitoring module collects information about the retrieval request, image queries, context information and recognition results. The usage database stores the information collected by the monitoring module.

公开(公告)号：US09176984B2

公开(公告)日：2015-11-03

申请号：US12253715

申请日：2008-10-17

申请人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

发明人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

IPC分类号： G06F17/30 ,  G06F7/00 ,  G06F21/00 ,  G06F21/10 ,  G06F21/78 ,  G06F21/80 ,  G06K9/00

CPC分类号： G06F17/30247 ,  G06F17/30017 ,  G06F17/30218 ,  G06F17/30876 ,  G06F21/00 ,  G06F21/10 ,  G06F21/78 ,  G06F21/80 ,  G06K9/00463

摘要： An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher integrated into a network with an advertiser, an ad broker, and an MMR service bureau. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR service bureau uses the result to retrieve advertising or other links associated with the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a differentially weighting links associated with an MMR document.

摘要翻译： 用于发布的MMR系统包括多个移动设备，MMR网关，MMR匹配单元和与广告商，广告经纪人和MMR服务局集成到网络中的MMR发布者。 MMR匹配单元从MMR网关接收图像查询，并将其发送到一个或多个识别单元，以识别包括文档，页面和页面上的位置的结果。 MMR服务局使用结果来检索与页面上的位置相关联的广告或其他链接。 结果和链接列表将发送回MMR网关，以便在移动设备上进行演示。 本发明还包括许多新颖的方法，包括与MMR文档相关联的差分加权链路。

公开(公告)号：US20150287228A1

公开(公告)日：2015-10-08

申请号：US14746669

申请日：2015-06-22

申请人： Jorge Moraleda ,  Berna Erol ,  Jonathan J. Hull

发明人： Jorge Moraleda ,  Berna Erol ,  Jonathan J. Hull

IPC分类号： G06T11/60 ,  G06T3/40 ,  G06K9/62 ,  G06F17/30

CPC分类号： G06T11/60 ,  G06F17/30247 ,  G06F17/30256 ,  G06K9/00463 ,  G06K9/228 ,  G06K9/32 ,  G06K9/6288 ,  G06K2009/2045 ,  G06T3/4053

摘要： An MMR system integrating image tracking and recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a recognition result. Image tracking information also is provided for determining relative locations of images to each other. The mobile device includes an image tracker for providing at least a portion of the image tracking information. The disclosure also includes methods for image tracking-assisted recognition, recognition of multiple images using a single image query, and improved image tracking using MMR recognition.

摘要翻译： 集成图像跟踪和识别的MMR系统包括多个移动设备，预处理服务器或MMR网关和MMR匹配单元，并且可以包括MMR发布者。 MMR匹配单元从预处理服务器或MMR网关接收图像查询，并将其发送到一个或多个识别单元以识别识别结果。 还提供图像跟踪信息以确定图像彼此的相对位置。 移动设备包括用于提供图像跟踪信息的至少一部分的图像跟踪器。 本公开还包括用于图像跟踪辅助识别，使用单个图像查询的多个图像的识别以及使用MMR识别的改进的图像跟踪的方法。

公开(公告)号：US09020966B2

公开(公告)日：2015-04-28

申请号：US12340124

申请日：2008-12-19

申请人： Berna Erol ,  Jorge Moraleda ,  Jonathan J. Hull

发明人： Berna Erol ,  Jorge Moraleda ,  Jonathan J. Hull

IPC分类号： G06F17/30 ,  G06K9/00 ,  G06K9/03 ,  G06K9/62

CPC分类号： G06F17/30247 ,  G06F17/30026 ,  G06F17/30038 ,  G06F17/30047 ,  G06F17/30876 ,  G06K9/00463 ,  G06K9/00979 ,  G06K9/036 ,  G06K9/6217 ,  G06K9/6227 ,  G06K9/6262 ,  G06K9/6292

摘要： The mobile device includes a client that has a number of modules, and the MMR Gateway and MMR matching unit are implemented as a server that has a number of modules. The implementation of the MMR system as a client and a server is advantageous because the modules may be distributed among the client and the server in a variety of configurations. The present invention includes a capture module, a preprocessing module, a feature extraction module, a retrieval module, a send message module, an action module, a prediction module, a feedback module, a sending module, an MMR database, a streaming module, an e-mail module, a voice recognition system and an audio database. These modules and systems are operational upon the client or the server.

摘要翻译： 移动设备包括具有多个模块的客户端，并且MMR网关和MMR匹配单元被实现为具有多个模块的服务器。 作为客户机和服务器的MMR系统的实现是有利的，因为模块可以以各种配置分布在客户端和服务器之间。 本发明包括捕获模块，预处理模块，特征提取模块，检索模块，发送消息模块，动作模块，预测模块，反馈模块，发送模块，MMR数据库，流模块， 电子邮件模块，语音识别系统和音频数据库。 这些模块和系统可在客户端或服务器上运行。

公开(公告)号：US08510283B2

公开(公告)日：2013-08-13

申请号：US12210519

申请日：2008-09-15

申请人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

发明人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/30247 ,  G06F17/30876 ,  G06K9/00463 ,  G06K9/00993 ,  G06K9/6227 ,  G06K9/6256 ,  G06K9/6262

摘要： A MMR system for newspaper publishing includes a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The image registration unit includes an indexing unit for generating images adapted to the environment and capabilities of the image capture device. The indexing unit also automatically adapts the configuration of the plurality of recognition units and index tables based upon image queries applied to the plurality of recognition and index tables. The plurality of recognition units and index tables are configured based on content they reference, recognition algorithm used or other factors.

摘要翻译： 用于报纸出版的MMR系统包括多个移动设备，MMR网关，MMR匹配单元和MMR发布者。 MMR匹配单元从MMR网关接收图像查询，并将其发送到一个或多个识别单元，以识别包括文档，页面和页面上的位置的结果。 图像注册单元包括索引单元，用于生成适于图像采集设备的环境和能力的图像。 索引单元还基于应用于多个识别和索引表的图像查询自动地适配多个识别单元和索引表的配置。 基于它们所引用的内容，所使用的识别算法或其他因素来配置多个识别单元和索引表。

公开(公告)号：US20090100048A1

公开(公告)日：2009-04-16

申请号：US12253715

申请日：2008-10-17

申请人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

发明人： Jonathan J. Hull ,  Berna Erol ,  Jorge Moraleda

IPC分类号： G06F17/30 ,  G06K9/62

CPC分类号： G06F17/30247 ,  G06F17/30017 ,  G06F17/30218 ,  G06F17/30876 ,  G06F21/00 ,  G06F21/10 ,  G06F21/78 ,  G06F21/80 ,  G06K9/00463

摘要： An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher integrated into a network with an advertiser, an ad broker, and an MMR service bureau. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR service bureau uses the result to retrieve advertising or other links associated with the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a differentially weighting links associated with an MMR document.

摘要翻译： 用于发布的MMR系统包括多个移动设备，MMR网关，MMR匹配单元和与广告商，广告经纪人和MMR服务局集成到网络中的MMR发布者。 MMR匹配单元从MMR网关接收图像查询，并将其发送到一个或多个识别单元，以识别包括文档，页面和页面上的位置的结果。 MMR服务局使用结果来检索与页面上的位置相关联的广告或其他链接。 结果和链接列表将发送回MMR网关，以便在移动设备上进行演示。 本发明还包括许多新颖的方法，包括与MMR文档相关联的差分加权链路。