公开(公告)号：US07528848B2

公开(公告)日：2009-05-05

申请号：US11169744

申请日：2005-06-30

申请人： An Xu ,  Chunhui Zhang ,  Jian Wang ,  Liyong Chen ,  Qiang Wang ,  Yingnong Dang

发明人： An Xu ,  Chunhui Zhang ,  Jian Wang ,  Liyong Chen ,  Qiang Wang ,  Yingnong Dang

IPC分类号： G09G5/00

CPC分类号： G06F3/03545

摘要： A method and system for decoding data on a medium that is captured by an input device is described. The method decodes a symbol design, such as an embedded interaction code (EIC), on a display screen, such as a liquid crystal display (LCD). An image that is captured by an input device, such as a universal pen-type input device with a camera, is received. The captured image is processed to output an extracted bit stream. Position data and/or metadata information is decoded from the extracted bit stream and a position of the captured image with respect to a screen of the LCD is determined based upon the decoded position data. The EIC pattern may be recognized from LCD pixel grids and a bit stream of EIC bits may be extracted based upon the recognized EIC pattern.

摘要翻译： 描述用于对由输入装置捕获的介质上的数据进行解码的方法和系统。 该方法在诸如液晶显示器（LCD）的显示屏上解码符号设计，例如嵌入式交互码（EIC）。 接收由输入装置拍摄的图像，例如具有照相机的通用笔型输入装置。 捕获的图像被处理以输出提取的比特流。 位置数据和/或元数据信息从提取的比特流解码，并且基于解码的位置数据确定捕获图像相对于LCD的屏幕的位置。 可以从LCD像素网格识别EIC图案，并且可以基于所识别的EIC图案来提取EIC位的比特流。

公开(公告)号：US20090067743A1

公开(公告)日：2009-03-12

申请号：US12138339

申请日：2008-06-12

申请人： Jian Wang ,  Liyong Chen ,  Yingnong Dang

发明人： Jian Wang ,  Liyong Chen ,  Yingnong Dang

IPC分类号： G06K9/40

CPC分类号： G06K9/228 ,  G06K9/38 ,  G06K2209/01

摘要： Pre-processing techniques for processing an image to improve the distinctiveness of an information pattern captured in the image before the information pattern is analyzed in a decoding process. The brightness of an image first is normalized by dividing the image into blocks of areas, such as pixels. A brightness distribution value then is determined for each area of the image by fitting the brightness of its surrounding blocks using bilinear interpolation and extrapolation, and a normalized brightness value for each area can then be obtained by dividing the original brightness value by the brightness distribution value. Next, masks are created to distinguish the information pattern from content captured in the image. The masks may be generated based upon contrast differences between the brightness of pixels representing the information pattern, the brightness of pixels representing content, and the brightness of pixels representing the background of the writing medium.

摘要翻译： 用于处理图像以提高在解码过程中分析信息模式之前在图像中捕获的信息模式的独特性的预处理技术。 首先通过将图像划分成诸如像素的区域的块来对图像的亮度进行归一化。 然后通过使用双线性插值和外插拟合其周围块的亮度来确定图像的每个区域的亮度分布值，然后可以通过将原始亮度值除以亮度分布值来获得每个区域的归一化亮度值 。 接下来，创建掩模以将信息模式与图像中捕获的内容区分开。 可以基于表示信息图案的像素的亮度，表示内容的像素的亮度和表示写入介质的背景的像素的亮度之间的对比度差异来生成掩模。

公开(公告)号：US20080313149A1

公开(公告)日：2008-12-18

申请号：US11818611

申请日：2007-06-15

申请人： Yanato Li ,  Adnan Azfar Mahmud ,  Wenli Zhu ,  Haidong Zhang ,  Shuguang Ye ,  Bing Sun ,  Qiang Wang ,  Yingnong Dang ,  Guowei Liu ,  Min Wang ,  Jian Wang

发明人： Yanato Li ,  Adnan Azfar Mahmud ,  Wenli Zhu ,  Haidong Zhang ,  Shuguang Ye ,  Bing Sun ,  Qiang Wang ,  Yingnong Dang ,  Guowei Liu ,  Min Wang ,  Jian Wang

IPC分类号： G06F17/30

CPC分类号： G06F11/3414 ,  G06F11/3438 ,  G06F11/3447 ,  G06F11/3476

摘要： Described is a technology by which software instrumentation data collected from user program sessions are analyzed to output an analysis report or the like via example methods and an architecture configured for efficient operation. A client component queries a service for analysis related information. To process the query, the service works with a data manager, and via a high dimensional analysis component may use information processed from the software instrumentation data, such as in the form of one or more inverted indexes and/or raw value files. The service may include a usage analysis component, a feature recognition component that locates features from command sequences, a user recognition component and/or a program reliability component. One or more counterpart components at the client may generate analysis reports or the like based on the query results. The client also may maintain user libraries and feature libraries to facilitate analyses.

摘要翻译： 描述了通过对用户程序会话收集的软件仪表数据进行分析以通过示例方法和配置为有效操作的架构来输出分析报告等的技术。 客户端组件向服务查询分析相关信息。 为了处理查询，该服务与数据管理器一起工作，并且通过高维分析组件可以使用从软件工具数据处理的信息，例如以一个或多个反向索引和/或原始值文件的形式。 该服务可以包括使用分析组件，从命令序列定位特征的特征识别组件，用户识别组件和/或程序可靠性组件。 客户端上的一个或多个对应组件可以基于查询结果生成分析报告等。 客户端还可以维护用户库和功能库，以便于分析。

公开(公告)号：US20070041654A1

公开(公告)日：2007-02-22

申请号：US11205448

申请日：2005-08-17

申请人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Chunhui Zhang

发明人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Chunhui Zhang

IPC分类号： G06K9/40

CPC分类号： G06K9/22 ,  G06K2009/226

摘要： At least one image captured from a printed document and at least one image captured from a display surface other than a printed document are processed. A surface-type-identification module accepts as input both types of images and identifies, for a particular image, the type of surface from which the image was captured. A display-surface-preprocessing module preprocesses the at least one embedded-interaction-code image captured from a display surface other than a printed document. A printed-document-preprocessing module preprocesses the at least one embedded-interaction-code images captured from a printed document. An embedded-interaction-code-processing module outputs location information for at least one of the at least one image captured from a printed document and the at least one image captured from a display surface other than a printed document.

摘要翻译： 处理从打印文档捕获的至少一个图像和从打印文档以外的显示表面捕获的至少一个图像。 表面类型识别模块接受两种类型的图像作为输入，并且针对特定图像识别捕获图像的表面的类型。 显示表面预处理模块预处理从打印文档以外的显示表面捕获的至少一个嵌入式交互代码图像。 打印文档预处理模块预处理从打印文档捕获的至少一个嵌入式交互代码图像。 嵌入式交互代码处理模块输出从打印文档捕获的至少一个图像中的至少一个图像和从打印文档以外的显示表面捕获的至少一个图像的位置信息。

公开(公告)号：US07136054B2

公开(公告)日：2006-11-14

申请号：US10753023

申请日：2004-01-06

申请人： Jian Wang ,  Liyong Chen ,  Yingnong Dang ,  Xiaoxu Ma

发明人： Jian Wang ,  Liyong Chen ,  Yingnong Dang ,  Xiaoxu Ma

IPC分类号： G09G5/00

CPC分类号： G06F3/03545 ,  G06F3/0321

摘要： X-y positions of a digital pen's tip may be determined by using a calibration parameter to map the x-y positions of the respective centers of images captured by the pen's camera. The calibration parameter may be generated by iteratively calculating estimates of the calibration parameter. Calibration input data may be produced by a user placing the pen tip in a fixed location on a surface, which may be a positionally encoded medium, such as paper, and then rotating the pen and/or moving the opposite end of the pen in various directions to capture multiple images for use in generating the calibration parameter. A user may perform such a calibration procedure without the need for complicated calibration equipment typically used in connection with conventional calibration techniques.

摘要翻译： 数字笔尖的X-Y位置可以通过使用校准参数来确定由笔的相机拍摄的各个中心的x-y位置来确定。 可以通过迭代地计算校准参数的估计来生成校准参数。 校准输入数据可以由用户将笔尖放置在表面上的固定位置（其可以是位置编码的介质，例如纸）然后旋转笔和/或使笔的相对端移动到各种 捕获多个图像以用于生成校准参数的方向。 用户可以执行这样的校准过程，而不需要通常结合常规校准技术使用的复杂校准设备。

公开(公告)号：US20060242561A1

公开(公告)日：2006-10-26

申请号：US11112672

申请日：2005-04-22

申请人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

发明人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

IPC分类号： G06F17/00

CPC分类号： G06F17/242 ,  G06F3/0321 ,  G06F3/03545

摘要： In accordance with embodiments of the invention, global metadata, such as a document identifier, which may be a globally unique identifier, is embedded into an embedded interactive code document by combining a first m-array and a plurality of copies of the first m-array to generate a combined m-array with encoded global metadata such that respective start positions (xd,yd)i of the plurality of copies of the first m-array in the combined m-array are each shifted, by respective amounts that are based on respective portions of the global metadata, relative to a start position of the first m-array in the combined m-array. Global metadata may be decoded from the combined m-array by determining the respective amounts by which the plurality of copies of the first m-array are shifted, relative to the first m-array, in the combined m-array and by combining the respective amounts to produce a decoded value of the global metadata.

摘要翻译： 根据本发明的实施例，通过组合第一m阵列和第一m-阵列的多个副本，将嵌入式交互式代码文档中的全局元数据（诸如可以是全局唯一标识符的文档标识符）嵌入到嵌入式交互式代码文档中， 阵列以生成具有编码的全局元数据的组合的m阵列，使得多个的数组的相应起始位置（x，d，y，...） 组合的m阵列中的第一m阵列的副本相对于组合的m阵列中的第一m阵列的开始位置分别移位相应于全局元数据的相应部分的量。 可以通过确定在组合的m阵列中第一m阵列的多个副本相对于第一m阵列移位的相应量，并通过组合相应的数组来组合全局元数据 相当于产生全局元数据的解码值。

公开(公告)号：US20050201621A1

公开(公告)日：2005-09-15

申请号：US10759357

申请日：2004-01-16

申请人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

发明人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

IPC分类号： G06T1/00 ,  B60Q1/14 ,  G06F3/03 ,  G06F3/033 ,  G06F3/042 ,  G06K9/00 ,  G06K9/22 ,  G06K9/46 ,  G09G5/00

CPC分类号： G06F3/03545 ,  G06F3/0321

摘要： Systems and methods that determine a path of a pen tip as the pen tip is moved across a document are described. The document is watermarked with a maze pattern from which encoded position information is determined. A sequence of images is captured by a camera that is located in a pen. The path of the pen tip is determined by decoding the associated maze pattern and by matching the captured images with document images. If the position coordinates of any frame that is associated with a stroke cannot be determined from m-array decoding, the frames are transformed and then matched with an area of a document image. Once the position coordinates of at least one frame is determined, the position coordinates of other frames are determined by matching the frames in a neighboring area.

摘要翻译： 描述当笔尖移动通过文档时确定笔尖的路径的系统和方法。 文档用迷宫图案加水印，从而确定编码位置信息。 图像序列由位于笔中的相机捕获。 笔尖的路径通过解码相关联的迷宫图案并通过将拍摄的图像与文档图像相匹配来确定。 如果不能从m阵列解码中确定与笔划相关联的任何帧的位置坐标，则将帧变换，然后与文档图像的区域匹配。 一旦确定了至少一帧的位置坐标，则通过匹配相邻区域中的帧来确定其他帧的位置坐标。

公开(公告)号：US20050147281A1

公开(公告)日：2005-07-07

申请号：US10752081

申请日：2004-01-07

申请人： Jian Wang ,  Liyong Chen ,  Yingnong Dang ,  Qiang Wang ,  Xiaoxu Ma

发明人： Jian Wang ,  Liyong Chen ,  Yingnong Dang ,  Qiang Wang ,  Xiaoxu Ma

IPC分类号： G06K9/20 ,  G06F3/00 ,  G06F3/03 ,  G06F3/033 ,  G06F17/30 ,  G06K9/00 ,  G06K9/22 ,  G06K9/24 ,  G06K9/30 ,  G06K9/34 ,  G06K9/50 ,  G06K9/62 ,  G06T1/00 ,  G06T7/00 ,  G06T7/60

CPC分类号： G06F3/0321 ,  G06F3/03545 ,  G06K9/222 ,  G06K9/24 ,  G06T7/74

摘要： An efficient technique is disclosed for determining a portion of a document corresponding to a captured image. When a user employs a pen to create a stroke in a document, images of the document are captured by a camera mounted on the pen. While the location of some of the images will be determined from, for example, an analysis of a pattern on the document that is captured by the image or a pixel-by-pixel comparison of the image with the document, the location of other images will be determined by segmenting the sequence of images into groups that correspond to the shape of the stroke. Information relating to located images in a segment can then be employed to determine the position of unlocated images in the segment. For example, a document search region for an unlocated image can be established based upon the position of a previous located image and a maximum velocity or acceleration of the pen. The rotation and scale of the unlocated image are estimated as the same of the located image, and the unlocated image is warped using the rotation and scale. A pixel-by-pixel comparison can then be made between the warped unlocated image and the document search region. Further, if the warped unlocated image is matched successfully, the transform parameters of the image can be further refined.

摘要翻译： 公开了一种用于确定与捕获图像相对应的文档的一部分的有效技术。 当用户使用笔在文档中创建笔画时，文档的图像由安装在笔上的相机捕获。 虽然一些图像的位置将通过例如对由图像捕获的文档上的图案或图像与文档的逐像素比较的分析来确定其他图像的位置 将通过将图像序列分割成对应于笔画形状的组来确定。 然后可以使用与片段中的定​​位图像相关的信息来确定片段中未定位图像的位置。 例如，可以基于先前定位的图像的位置和笔的最大速度或加速度来建立用于未定位图像的文档搜索区域。 未定位图像的旋转和缩放被估计为与所定位的图像相同，并且使用旋转和刻度来扭曲未定位的图像。 然后可以在翘曲的未定位图像和文档搜索区域之间进行逐像素比较。 此外，如果翘曲的未定位图像成功匹配，则可以进一步改进图像的变换参数。

公开(公告)号：US08156153B2

公开(公告)日：2012-04-10

申请号：US12180484

申请日：2008-07-25

申请人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

发明人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

IPC分类号： G06F7/00 ,  G06F17/00 ,  G06K9/00

CPC分类号： G06F17/242 ,  G06F3/0321 ,  G06F3/03545

摘要： Global metadata, such as a document identifier, which may be a globally unique identifier, is embedded into an embedded interactive code document by combining a first m-array and a plurality of copies of the first m-array to generate a combined m-array with encoded global metadata such that respective start positions (xd, yd)i of the plurality of copies of the first m-array in the combined m-array are each shifted, by respective amounts that are based on respective portions of the global metadata, relative to a start position of the first m-array in the combined m-array. Global metadata may be decoded from the combined m-array by determining the respective amounts by which the plurality of copies of the first m-array are shifted, relative to the first m-array, in the combined m-array and by combining the respective amounts to produce a decoded value of the global metadata.

摘要翻译： 通过组合第一m阵列和第一m阵列的多个副本来将全局元数据（诸如可以是全球唯一标识符的文档标识符）嵌入到嵌入式交互式代码文档中以生成组合的m阵列 具有编码的全局元数据，使得组合的m阵列中的第一m阵列的多个副本中的各个开始位置（xd，yd）i分别被移动，基于全局元数据的相应部分的相应量， 相对于组合的m阵列中的第一m阵列的开始位置。 可以通过确定在组合的m阵列中第一m阵列的多个副本相对于第一m阵列移位的相应量，并通过组合相应的数组来组合全局元数据 相当于产生全局元数据的解码值。

公开(公告)号：US07684618B2

公开(公告)日：2010-03-23

申请号：US11385869

申请日：2006-03-22

申请人： Jian Wang ,  Yingnong Dang ,  Jiang Wu ,  Xiaoxu Ma

发明人： Jian Wang ,  Yingnong Dang ,  Jiang Wu ,  Xiaoxu Ma

IPC分类号： G06K9/34

CPC分类号： H04N19/94 ,  G06F3/03545

摘要： A system and method for encoding a document image and finding a location based on that image are described. A document page is encoded into codes associated with various locations of the document page. The codes are assembled into a code book. Captured images may then be similarly encoded and searched against the codes in the codebook. One or more codes and associated locations may be returned, thereby providing one or more possible locations for the captured images.

摘要翻译： 描述了用于对文档图像进行编码并基于该图像找到位置的系统和方法。 文档页面被编码成与文档页面的各个位置相关联的代码。 代码汇编成代码簿。 然后，捕获的图像可以相对于码本中的代码进行相似的编码和搜索。 可以返回一个或多个代码和相关联的位置，从而为捕获的图像提供一个或多个可能的位置。