公开(公告)号：US09547938B2

公开(公告)日：2017-01-17

申请号：US13117527

申请日：2011-05-27

申请人： Gurumurthy D. Ramkumar ,  William F. Stasior ,  Bryan E. Feldman ,  Arnab S. Dhua ,  Nalin Pradeep Senthamil

发明人： Gurumurthy D. Ramkumar ,  William F. Stasior ,  Bryan E. Feldman ,  Arnab S. Dhua ,  Nalin Pradeep Senthamil

IPC分类号： G06T19/00 ,  G06F17/30 ,  G06F3/01 ,  G06F15/16

CPC分类号： G06T19/006 ,  G06F3/011 ,  G06F3/04842 ,  G06F15/16 ,  G06F17/30047 ,  G06F17/30528 ,  G06K9/4604 ,  G06K9/6202 ,  G06Q30/0643 ,  G06T19/00 ,  G06T2210/12

摘要： Techniques for augmenting an image of an object captured and displayed in real time with associated content are disclosed. In one embodiment, the method for augmenting the image includes receiving information defining a sampled frame of a video being captured by an electronic device in substantially real time, determining information representative of an object captured in the sampled frame based on the received information, causing the determined information to match stored information defining a plurality of items to locate an item matched to the captured object, retrieving content associated with the matched item, and providing the retrieved content for display with the captured image on the electronic device. The retrieved content may be rendered in an overlay element that overlays the captured image displayed on the electronic device. The rendered content is configured to enable a user to interact with the content.

摘要翻译： 公开了用于增加用相关内容实时捕获和显示的对象的图像的技术。 在一个实施例中，用于增强图像的方法包括基本上实时地接收定义由电子设备捕获的视频的采样帧的信息，基于接收到的信息确定表示采样帧中捕获的对象的信息， 确定信息以匹配定义多个项目的存储信息，以定位与捕获对象匹配的项目，检索与匹配项目相关联的内容，以及在电子设备上提供所检索的内容以与所捕获的图像一起显示。 检索到的内容可以在覆盖显示在电子设备上的捕获图像的覆盖元素中呈现。 呈现的内容被配置为使得用户能够与内容交互。

公开(公告)号：US09104701B1

公开(公告)日：2015-08-11

申请号：US13482717

申请日：2012-05-29

申请人： Michael Q. Phung ,  Arnab S. Dhua ,  Ketan R. Deshpande ,  Sunil Ramesh

发明人： Michael Q. Phung ,  Arnab S. Dhua ,  Ketan R. Deshpande ,  Sunil Ramesh

IPC分类号： G06K9/68 ,  G06F17/30

CPC分类号： G06F17/30256 ,  G06F17/30047 ,  G06F17/3005 ,  G06F17/30277

摘要： Subjective user-generated data can be utilized to determine visually similar items. Various item descriptors can be determined for a pair of items, which can provide an objective measure of visual aspects of those items, such as how similar those items are in color, style, material, or texture. The ways in which users interact with data for those items, either explicitly or implicitly through user behavior, can provide a level of perceived visual similarity on behalf of these users. The perceived, subjective visual similarity data from the users can be used to adjust a weighting of the various item descriptor factors for a pair of items, or otherwise adjust a visual similarity score, such that items selected as being visually similar more accurately reflect the subjective opinions of the users.

摘要翻译： 主观用户生成的数据可用于确定视觉上相似的项目。 可以为一对项目确定各种项目描述符，这些项目可以提供这些项目的视觉方面的客观测量，诸如这些项目在颜色，样式，材料或纹理中的相似度。 用户通过用户行为明确或隐含地与这些项目的数据进行交互的方式可以代表这些用户提供一定程度的感知视觉相似度。 可以使用来自用户的感知的，主观的视觉相似性数据来调整一对项目的各种项目描述符因子的加权，或者另外调整视觉相似性得分，使得被选择为视觉上类似的项目更准确地反映主观 用户意见。

公开(公告)号：US08733650B1

公开(公告)日：2014-05-27

申请号：US13465900

申请日：2012-05-07

申请人： Aleksandr V. Segal ,  Arnab S. Dhua ,  Max Delgadillo

发明人： Aleksandr V. Segal ,  Arnab S. Dhua ,  Max Delgadillo

IPC分类号： G06K5/00

CPC分类号： G06K7/1404 ,  A63B53/02 ,  A63B53/0466 ,  A63B2053/0433 ,  A63B2053/0445 ,  A63B2053/0458 ,  A63B2209/00

摘要： Various algorithms are presented that enable an image of a barcode, captured by a camera of an electronic device, to be analyzed and decoded for use in obtaining information about an object or item associated with the barcode. The algorithms can account for variations in focus of the image, as may result in blur due to movement or a lack of auto-focus features. An offline training phase can be used to generate a set of possible symbol appearance templates, where at least some of the templates reflect simulations for varying levels and types of noise in an image. A decoding phase compares these templates to a captured image and performs a sequence-wide optimization to determine the overall most likely sequence of digits.

摘要翻译： 呈现各种算法，使得能够分析和解码由电子设备的照相机拍摄的条形码的图像，以用于获得关于与条形码相关联的对象或物品的信息。 这些算法可以解释图像焦点的变化，因为可能会由于移动或缺少自动对焦的特征造成模糊。 离线训练阶段可以用于生成一组可能的符号外观模板，其中至少一些模板反映了图像中不同级别和类型的噪声的模拟。 解码阶段将这些模板与捕获的图像进行比较，并执行序列范围优化以确定整体最可能的数字序列。

公开(公告)号：US08413903B1

公开(公告)日：2013-04-09

申请号：US13095230

申请日：2011-04-27

申请人： Arnab S Dhua ,  Max Delgadillo

发明人： Arnab S Dhua ,  Max Delgadillo

IPC分类号： G02B26/10

CPC分类号： G06K7/1408 ,  G06K7/10821 ,  G06K7/1439 ,  G06K7/1465

摘要： Various algorithms are presented that enable an image of a barcode, captured by a camera of an electronic device, to be decoded on the device without need to upload the image information to a server for processing. The algorithms can account for variations in focus of the image, as may result in blur due to move movement or auto-focus features. The approaches can handle multiple barcode formats, and can handle barcodes on curved surfaces, barcodes with damaged areas, or barcodes that are otherwise uneven. Such algorithms are highly accurate while being fast and lightweight enough to execute on portable electronic devices, such as tablet computers and smart phones.

摘要翻译： 提出了使得能够在设备上解码由电子设备的照相机拍摄的条形码的图像的各种算法，而不需要将图像信息上传到服务器进行处理。 这些算法可以解释图像焦点的变化，因为可能会由于移动移动或自动对焦功能而导致模糊。 这些方法可以处理多种条形码格式，并且可以处理弯曲表面上的条形码，损坏区域的条形码或否则不均匀的条形码。 这样的算法是高度精确的，同时快速和轻量化足以在诸如平板电脑和智能电话的便携式电子设备上执行。

公开(公告)号：US20120299961A1

公开(公告)日：2012-11-29

申请号：US13117527

申请日：2011-05-27

申请人： Gurumurthy D. Ramkumar ,  William F. Stasior ,  Bryan E. Feldman ,  Arnab S. Dhua ,  Nalin Pradeep Senthamil

发明人： Gurumurthy D. Ramkumar ,  William F. Stasior ,  Bryan E. Feldman ,  Arnab S. Dhua ,  Nalin Pradeep Senthamil

IPC分类号： G09G5/00

CPC分类号： G06T19/006 ,  G06F3/011 ,  G06F3/04842 ,  G06F15/16 ,  G06F17/30047 ,  G06F17/30528 ,  G06K9/4604 ,  G06K9/6202 ,  G06Q30/0643 ,  G06T19/00 ,  G06T2210/12

摘要： Techniques for augmenting an image of an object captured and displayed in real time with associated content are disclosed. In one embodiment, the method for augmenting the image includes receiving information defining a sampled frame of a video being captured by an electronic device in substantially real time, determining information representative of an object captured in the sampled frame based on the received information, causing the determined information to match stored information defining a plurality of items to locate an item matched to the captured object, retrieving content associated with the matched item, and providing the retrieved content for display with the captured image on the electronic device. The retrieved content may be rendered in an overlay element that overlays the captured image displayed on the electronic device. The rendered content is configured to enable a user to interact with the content.

摘要翻译： 公开了用于增加用相关内容实时捕获和显示的对象的图像的技术。 在一个实施例中，用于增强图像的方法包括基本上实时地接收定义由电子设备捕获的视频的采样帧的信息，基于接收到的信息确定表示采样帧中捕获的对象的信息， 确定信息以匹配定义多个项目的存储信息，以定位与捕获对象匹配的项目，检索与匹配项目相关联的内容，以及在电子设备上提供所检索的内容以与所捕获的图像一起显示。 检索到的内容可以在覆盖显示在电子设备上的捕获图像的覆盖元素中呈现。 呈现的内容被配置为使得用户能够与内容交互。

公开(公告)号：US20090179916A1

公开(公告)日：2009-07-16

申请号：US12008370

申请日：2008-01-10

申请人： Steven A. Williams ,  Arnab S. Dhua

发明人： Steven A. Williams ,  Arnab S. Dhua

IPC分类号： G06F3/00

CPC分类号： G06T7/80 ,  G06T2207/30252

摘要： A method and apparatus for calibrating a video display overlay. The method includes the steps of providing calibration indicia, providing an image capture device and an image processor operatively connected to the image capture device, positioning the image capture device with respect to the calibration indicia, capturing an image of the calibration indicia using the image capture device, analyzing the image using the image processor to identify the portions of the image that correspond to the calibration indicia, outputting the result as calibration indicia position data, and calculating a calibration data set based on the calibration indicia position data using the image processor. The apparatus includes calibration indicia, an image capture device directed toward the calibration indicia for providing a reference image, and an image processor electrically connected to the image capture device.

摘要翻译： 一种用于校准视频显示覆盖的方法和装置。 该方法包括以下步骤：提供校准标记，提供图像捕获装置和可操作地连接到图像捕获装置的图像处理器，相对于校准标记定位图像捕获装置，使用图像捕获捕获校准标记的图像 使用图像处理器分析图像以识别与校准标记相对应的图像部分，输出结果作为校准标记位置数据，以及使用图像处理器基于校准标记位置数据计算校准数据集。 该装置包括校准标记，朝向用于提供参考图像的校准标记的图像捕获装置，以及电连接到图像捕获装置的图像处理器。

公开(公告)号：US08582821B1

公开(公告)日：2013-11-12

申请号：US13113989

申请日：2011-05-23

申请人： Bryan E. Feldman ,  Nalin Pradeep Senthamil ,  Arnab S. Dhua ,  Gurumurthy D. Ramkumar

发明人： Bryan E. Feldman ,  Nalin Pradeep Senthamil ,  Arnab S. Dhua ,  Gurumurthy D. Ramkumar

IPC分类号： G06K9/00

CPC分类号： G06T7/248 ,  G06T7/20 ,  G06T7/254 ,  G06T2207/10016

摘要： Systems and methods track one or more points between images. A point for tracking may be selected, at least in part, on a determination of how discriminable the point is relative to other points in a region containing the point. A point of an image being tracked may be located in another image by matching a patch containing the point with another patch of the other image. A search for a matching patch may be focused in a region that is determined based at least in part on an estimate of movement of the point between images. Points may be tracked across multiple images. If an ability to track one or more points is lost, information about the points being tracked may be used to relocate the points in another image.

摘要翻译： 系统和方法跟踪图像之间的一个或多个点。 可以至少部分地选择用于跟踪的点，以确定点相对于包含该点的区域中的其他点的可区分性。 跟踪的图像的点可以通过将包含该点的补丁与另一图像的另一个补丁相匹配来定位在另一图像中。 可以在至少部分地基于图像之间的点的移动的估计来确定的区域中聚焦对匹配补丁的搜索。 点数可以跨越多个图像进行跟踪。 如果跟踪一个或多个点的能力丢失，则关于要跟踪的点的信息可以用于重新定位另一个图像中的点。

公开(公告)号：US20130254235A1

公开(公告)日：2013-09-26

申请号：US13621171

申请日：2012-09-15

申请人： Arnab S. Dhua ,  Sunil Ramesh ,  Max Delgadillo ,  Raghavan Manmatha

发明人： Arnab S. Dhua ,  Sunil Ramesh ,  Max Delgadillo ,  Raghavan Manmatha

IPC分类号： G06F17/30

CPC分类号： G06F17/30256 ,  G06F17/30247 ,  G06F17/30259 ,  G06F17/30542 ,  G06F17/30867 ,  G06K9/46 ,  G06K9/6203

摘要： Systems and approaches for searching a content collection corresponding to query content are provided. In particular, false positive match rates between the query content and the content collection may be reduced with a minimum content region test and/or a minimum features per scale test. For example, by correlating content descriptors of a content piece in the content collection with query descriptors of the query content, the content piece can be determined to match the query content when a particular region of the content piece and/or a particular region of a query descriptor have a proportionate size meeting or exceeding a specified minimum. Alternatively, or in addition, the false positive match rate between query content and a content piece can be reduced by comparing content descriptors and query descriptors of features at a plurality of scales. A content piece can be determined to match the query content according to descriptor proportion quotas for the plurality of scales.

公开(公告)号：US08352483B1

公开(公告)日：2013-01-08

申请号：US12778957

申请日：2010-05-12

申请人： Sunil Ramesh ,  Arnab S. Dhua ,  Max Delgadillo ,  Raghavan Manmatha

发明人： Sunil Ramesh ,  Arnab S. Dhua ,  Max Delgadillo ,  Raghavan Manmatha

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/3002

摘要： Multiple paths of an index tree may be traversed to discover a set of content descriptors that are match candidates for a set of query descriptors. A size of the set of candidate content descriptors may be optimized, for example, to reduce false positive matching errors, query latencies and/or index tree traversal times, at least in part by determining a number of child nodes to traverse based at least in part on current traverse level and/or traverse neighborhood thresholds. Index trees for large content descriptor sets may be built in resource constrained environments with approximation and/or refining build techniques.

摘要翻译： 可以遍历索引树的多个路径以发现与一组查询描述符匹配候选的一组内容描述符。 可以优化候选内容描述符集合的大小，例如，至少部分地通过基于至少在...中确定要遍历的子节点的数量来减少假阳性匹配错误，查询延迟和/或索引树遍历时间 部分电流横越电平和/或横越邻域阈值。 用于大内容描述符集的索引树可以在具有近似和/或精炼构建技术的资源约束环境中构建。

公开(公告)号：US07676087B2

公开(公告)日：2010-03-09

申请号：US11523986

申请日：2006-09-20

申请人： Arnab S. Dhua ,  Yan Zhang ,  Stephen J. Kiselewich

发明人： Arnab S. Dhua ,  Yan Zhang ,  Stephen J. Kiselewich

IPC分类号： G06K9/00

CPC分类号： G06K9/3241 ,  B60W30/08 ,  G06K9/00805 ,  G06K2209/23 ,  G06T7/70 ,  G08G1/16 ,  G08G1/166

摘要： A method for identifying objects in an electronic image is provided. The method includes the steps of providing an electronic source image and processing the electronic source image to identify edge pixels. The method further includes the steps of providing an electronic representation of the edge pixels and processing the electronic representation of the edge pixels to identify valid edge center pixels. The method still further includes the step of proving an electronic representation of the valid edge center pixels. Each valid edge center pixel represents the approximate center of a horizontal edge segment of a target width. The horizontal edge segment is made up of essentially contiguous edge pixels. The method also includes the steps of determining symmetry values of test regions associated with valid edge center pixels, and classifying the test regions based on factors including symmetry.

摘要翻译： 提供了一种用于识别电子图像中的对象的方法。 该方法包括提供电子源图像和处理电子源图像以识别边缘像素的步骤。 该方法还包括提供边缘像素的电子表示并处理边缘像素的电子表示以识别有效边缘中心像素的步骤。 该方法还包括证明有效边缘中心像素的电子表示的步骤。 每个有效的边缘中心像素表示目标宽度的水平边缘片段的大致中心。 水平边缘段由基本上相邻的边缘像素组成。 该方法还包括以下步骤：确定与有效边缘中心像素相关联的测试区域的对称值，以及基于包括对称性的因素对测试区域进行分类。