公开(公告)号：US20090016614A1

公开(公告)日：2009-01-15

申请号：US12211473

申请日：2008-09-16

申请人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

发明人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

IPC分类号： G06K9/64

CPC分类号： G06F3/03545 ,  G06F3/0321

摘要： An efficient technique is provided for determining a portion of a document corresponding to a captured image. Areas of a document in which the pattern is at least partially obscured are identified. A reference pixel in the image is selected, and an offset between the pixel and the pattern is determined. A pixel-by-pixel comparison is then made of the image with the document such that the reference pixel is only compared with locations in the document that are both within the identified areas and have the determined offset from the pattern. The comparison with the highest correspondence between the image pixels and the electronic document then identifies the position of the reference pixel relative to the electronic document.

摘要翻译： 提供了一种用于确定与捕获图像相对应的文档的一部分的有效技术。 识别出图案至少部分模糊的文档的区域。 选择图像中的参考像素，并且确定像素和图案之间的偏移。 然后，对具有文档的图像进行逐像素比较，使得仅将参考像素与文档中位于所识别的区域内的位置进行比较，并且具有从图案确定的偏移。 与图像像素和电子文档之间的最高对应关系的比较然后识别参考像素相对于电子文档的位置。

公开(公告)号：US07421439B2

公开(公告)日：2008-09-02

申请号：US11112672

申请日：2005-04-22

申请人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

发明人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

IPC分类号： G06F7/00 ,  G06F17/00 ,  G06K9/00

CPC分类号： G06F17/242 ,  G06F3/0321 ,  G06F3/03545

摘要： Global metadata, such as a document identifier, which may be a globally unique identifier, is embedded into an embedded interactive code document by combining a first m-array and a plurality of copies of the first m-array to generate a combined m-array with encoded global metadata such that respective start positions (xd,yd)i of the plurality of copies of the first m-array in the combined m-array are each shifted, by respective amounts that are based on respective portions of the global metadata, relative to a start position of the first m-array in the combined m-array. Global metadata may be decoded from the combined m-array by determining the respective amounts by which the plurality of copies of the first m-array are shifted, relative to the first m-array, in the combined m-array and by combining the respective amounts to produce a decoded value of the global metadata.

摘要翻译： 通过组合第一m阵列和第一m阵列的多个副本来将全局元数据（诸如可以是全球唯一标识符的文档标识符）嵌入到嵌入式交互式代码文档中以生成组合的m阵列 具有编码的全局元数据，使得第一m阵列的多个拷贝的相应开始位置（x，d，i，...， 组合的m阵列相对于组合的m阵列中的第一m阵列的开始位置而被移位，相应于基于全局元数据的相应部分的量。 可以通过确定在组合的m阵列中第一m阵列的多个副本相对于第一m阵列移位的相应量，并通过组合相应的数组来组合全局元数据 相当于产生全局元数据的解码值。

公开(公告)号：US20060242622A1

公开(公告)日：2006-10-26

申请号：US11112604

申请日：2005-04-22

申请人： Qiang Wang ,  Liyong Chen ,  Yingnong Dang ,  Jiang Wu ,  Jian Wang

发明人： Qiang Wang ,  Liyong Chen ,  Yingnong Dang ,  Jiang Wu ,  Jian Wang

IPC分类号： G06F9/44

CPC分类号： G06K7/1456 ,  G06F3/0321 ,  G06K7/14

摘要： In accordance with embodiments of the invention, embedded interaction code (EIC) symbols are recognized. EIC dots are generated based on effective EIC symbols, which have been generated by processing an image containing the EIC symbols, by obtaining graylevels of selected positions of the EIC-symbols. Rotated EIC dots are generated based on the EIC dots by determining which grid cells correspond to the EIC symbols and by determining which direction is a correct orientation of the EIC symbols. A homography matrix is updated with orientation information based on the EIC dots. EIC bits are extracted from the rotated EIC dots based on graylevels of selected positions of the rotated EIC dots.

公开(公告)号：US07885465B2

公开(公告)日：2011-02-08

申请号：US12211473

申请日：2008-09-16

申请人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

发明人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

IPC分类号： G06K9/68 ,  G06K9/62 ,  G06K19/06 ,  G06F3/033

CPC分类号： G06F3/03545 ,  G06F3/0321

摘要： An efficient technique is provided for determining a portion of a document corresponding to a captured image. Areas of a document in which the pattern is at least partially obscured are identified. A reference pixel in the image is selected, and an offset between the pixel and the pattern is determined. A pixel-by-pixel comparison is then made of the image with the document such that the reference pixel is only compared with locations in the document that are both within the identified areas and have the determined offset from the pattern. The comparison with the highest correspondence between the image pixels and the electronic document then identifies the position of the reference pixel relative to the electronic document.

摘要翻译： 提供了一种用于确定与捕获图像相对应的文档的一部分的有效技术。 识别出图案至少部分模糊的文档的区域。 选择图像中的参考像素，并且确定像素和图案之间的偏移。 然后，对具有文档的图像进行逐像素比较，使得仅将参考像素与文档中位于所识别的区域内的位置进行比较，并且具有从图案确定的偏移。 与图像像素和电子文档之间的最高对应关系的比较然后识别参考像素相对于电子文档的位置。

公开(公告)号：US07580576B2

公开(公告)日：2009-08-25

申请号：US11142910

申请日：2005-06-02

申请人： Jian Wang ,  Jiang Wu ,  Liyong Chen ,  Qiang Wang ,  Yingnong Dang ,  Youjun Liu

发明人： Jian Wang ,  Jiang Wu ,  Liyong Chen ,  Qiang Wang ,  Yingnong Dang ,  Youjun Liu

IPC分类号： G06K9/00

CPC分类号： G06F3/038 ,  G06F3/03545

摘要： A method and apparatus for capturing information encoded within a surface, such as location information or document metadata, and associating the information with a document is described. The captured information may be obtained by a camera associated with a pointing or writing device having a camera, such as an image-capturing pen.

摘要翻译： 描述用于捕获表面内编码的信息（诸如位置信息或文档元数据）以及将信息与文档相关联的方法和装置。 捕获的信息可以通过与具有诸如图像捕获笔的相机的指示或写入装置相关联的相机获得。

公开(公告)号：US07528848B2

公开(公告)日：2009-05-05

申请号：US11169744

申请日：2005-06-30

申请人： An Xu ,  Chunhui Zhang ,  Jian Wang ,  Liyong Chen ,  Qiang Wang ,  Yingnong Dang

发明人： An Xu ,  Chunhui Zhang ,  Jian Wang ,  Liyong Chen ,  Qiang Wang ,  Yingnong Dang

IPC分类号： G09G5/00

CPC分类号： G06F3/03545

摘要： A method and system for decoding data on a medium that is captured by an input device is described. The method decodes a symbol design, such as an embedded interaction code (EIC), on a display screen, such as a liquid crystal display (LCD). An image that is captured by an input device, such as a universal pen-type input device with a camera, is received. The captured image is processed to output an extracted bit stream. Position data and/or metadata information is decoded from the extracted bit stream and a position of the captured image with respect to a screen of the LCD is determined based upon the decoded position data. The EIC pattern may be recognized from LCD pixel grids and a bit stream of EIC bits may be extracted based upon the recognized EIC pattern.

摘要翻译： 描述用于对由输入装置捕获的介质上的数据进行解码的方法和系统。 该方法在诸如液晶显示器（LCD）的显示屏上解码符号设计，例如嵌入式交互码（EIC）。 接收由输入装置拍摄的图像，例如具有照相机的通用笔型输入装置。 捕获的图像被处理以输出提取的比特流。 位置数据和/或元数据信息从提取的比特流解码，并且基于解码的位置数据确定捕获图像相对于LCD的屏幕的位置。 可以从LCD像素网格识别EIC图案，并且可以基于所识别的EIC图案来提取EIC位的比特流。

公开(公告)号：US20070041654A1

公开(公告)日：2007-02-22

申请号：US11205448

申请日：2005-08-17

申请人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Chunhui Zhang

发明人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Chunhui Zhang

IPC分类号： G06K9/40

CPC分类号： G06K9/22 ,  G06K2009/226

摘要： At least one image captured from a printed document and at least one image captured from a display surface other than a printed document are processed. A surface-type-identification module accepts as input both types of images and identifies, for a particular image, the type of surface from which the image was captured. A display-surface-preprocessing module preprocesses the at least one embedded-interaction-code image captured from a display surface other than a printed document. A printed-document-preprocessing module preprocesses the at least one embedded-interaction-code images captured from a printed document. An embedded-interaction-code-processing module outputs location information for at least one of the at least one image captured from a printed document and the at least one image captured from a display surface other than a printed document.

摘要翻译： 处理从打印文档捕获的至少一个图像和从打印文档以外的显示表面捕获的至少一个图像。 表面类型识别模块接受两种类型的图像作为输入，并且针对特定图像识别捕获图像的表面的类型。 显示表面预处理模块预处理从打印文档以外的显示表面捕获的至少一个嵌入式交互代码图像。 打印文档预处理模块预处理从打印文档捕获的至少一个嵌入式交互代码图像。 嵌入式交互代码处理模块输出从打印文档捕获的至少一个图像中的至少一个图像和从打印文档以外的显示表面捕获的至少一个图像的位置信息。

公开(公告)号：US20060242561A1

公开(公告)日：2006-10-26

申请号：US11112672

申请日：2005-04-22

申请人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

发明人： Jian Wang ,  Zhouchen Lin ,  Yue Li ,  Chunhui Zhang ,  Yingnong Dang ,  Jiang Wu ,  Qiang Wang

IPC分类号： G06F17/00

CPC分类号： G06F17/242 ,  G06F3/0321 ,  G06F3/03545

摘要： In accordance with embodiments of the invention, global metadata, such as a document identifier, which may be a globally unique identifier, is embedded into an embedded interactive code document by combining a first m-array and a plurality of copies of the first m-array to generate a combined m-array with encoded global metadata such that respective start positions (xd,yd)i of the plurality of copies of the first m-array in the combined m-array are each shifted, by respective amounts that are based on respective portions of the global metadata, relative to a start position of the first m-array in the combined m-array. Global metadata may be decoded from the combined m-array by determining the respective amounts by which the plurality of copies of the first m-array are shifted, relative to the first m-array, in the combined m-array and by combining the respective amounts to produce a decoded value of the global metadata.

摘要翻译： 根据本发明的实施例，通过组合第一m阵列和第一m-阵列的多个副本，将嵌入式交互式代码文档中的全局元数据（诸如可以是全局唯一标识符的文档标识符）嵌入到嵌入式交互式代码文档中， 阵列以生成具有编码的全局元数据的组合的m阵列，使得多个的数组的相应起始位置（x，d，y，...） 组合的m阵列中的第一m阵列的副本相对于组合的m阵列中的第一m阵列的开始位置分别移位相应于全局元数据的相应部分的量。 可以通过确定在组合的m阵列中第一m阵列的多个副本相对于第一m阵列移位的相应量，并通过组合相应的数组来组合全局元数据 相当于产生全局元数据的解码值。

公开(公告)号：US20050201621A1

公开(公告)日：2005-09-15

申请号：US10759357

申请日：2004-01-16

申请人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

发明人： Jian Wang ,  Yingnong Dang ,  Qiang Wang ,  Liyong Chen ,  Xiaoxu Ma

IPC分类号： G06T1/00 ,  B60Q1/14 ,  G06F3/03 ,  G06F3/033 ,  G06F3/042 ,  G06K9/00 ,  G06K9/22 ,  G06K9/46 ,  G09G5/00

CPC分类号： G06F3/03545 ,  G06F3/0321

摘要： Systems and methods that determine a path of a pen tip as the pen tip is moved across a document are described. The document is watermarked with a maze pattern from which encoded position information is determined. A sequence of images is captured by a camera that is located in a pen. The path of the pen tip is determined by decoding the associated maze pattern and by matching the captured images with document images. If the position coordinates of any frame that is associated with a stroke cannot be determined from m-array decoding, the frames are transformed and then matched with an area of a document image. Once the position coordinates of at least one frame is determined, the position coordinates of other frames are determined by matching the frames in a neighboring area.

摘要翻译： 描述当笔尖移动通过文档时确定笔尖的路径的系统和方法。 文档用迷宫图案加水印，从而确定编码位置信息。 图像序列由位于笔中的相机捕获。 笔尖的路径通过解码相关联的迷宫图案并通过将拍摄的图像与文档图像相匹配来确定。 如果不能从m阵列解码中确定与笔划相关联的任何帧的位置坐标，则将帧变换，然后与文档图像的区域匹配。 一旦确定了至少一帧的位置坐标，则通过匹配相邻区域中的帧来确定其他帧的位置坐标。

公开(公告)号：US20050147281A1

公开(公告)日：2005-07-07

申请号：US10752081

申请日：2004-01-07

申请人： Jian Wang ,  Liyong Chen ,  Yingnong Dang ,  Qiang Wang ,  Xiaoxu Ma

发明人： Jian Wang ,  Liyong Chen ,  Yingnong Dang ,  Qiang Wang ,  Xiaoxu Ma

IPC分类号： G06K9/20 ,  G06F3/00 ,  G06F3/03 ,  G06F3/033 ,  G06F17/30 ,  G06K9/00 ,  G06K9/22 ,  G06K9/24 ,  G06K9/30 ,  G06K9/34 ,  G06K9/50 ,  G06K9/62 ,  G06T1/00 ,  G06T7/00 ,  G06T7/60

CPC分类号： G06F3/0321 ,  G06F3/03545 ,  G06K9/222 ,  G06K9/24 ,  G06T7/74

摘要： An efficient technique is disclosed for determining a portion of a document corresponding to a captured image. When a user employs a pen to create a stroke in a document, images of the document are captured by a camera mounted on the pen. While the location of some of the images will be determined from, for example, an analysis of a pattern on the document that is captured by the image or a pixel-by-pixel comparison of the image with the document, the location of other images will be determined by segmenting the sequence of images into groups that correspond to the shape of the stroke. Information relating to located images in a segment can then be employed to determine the position of unlocated images in the segment. For example, a document search region for an unlocated image can be established based upon the position of a previous located image and a maximum velocity or acceleration of the pen. The rotation and scale of the unlocated image are estimated as the same of the located image, and the unlocated image is warped using the rotation and scale. A pixel-by-pixel comparison can then be made between the warped unlocated image and the document search region. Further, if the warped unlocated image is matched successfully, the transform parameters of the image can be further refined.

摘要翻译： 公开了一种用于确定与捕获图像相对应的文档的一部分的有效技术。 当用户使用笔在文档中创建笔画时，文档的图像由安装在笔上的相机捕获。 虽然一些图像的位置将通过例如对由图像捕获的文档上的图案或图像与文档的逐像素比较的分析来确定其他图像的位置 将通过将图像序列分割成对应于笔画形状的组来确定。 然后可以使用与片段中的定​​位图像相关的信息来确定片段中未定位图像的位置。 例如，可以基于先前定位的图像的位置和笔的最大速度或加速度来建立用于未定位图像的文档搜索区域。 未定位图像的旋转和缩放被估计为与所定位的图像相同，并且使用旋转和刻度来扭曲未定位的图像。 然后可以在翘曲的未定位图像和文档搜索区域之间进行逐像素比较。 此外，如果翘曲的未定位图像成功匹配，则可以进一步改进图像的变换参数。