公开(公告)号：US08358866B2

公开(公告)日：2013-01-22

申请号：US12223283

申请日：2007-01-29

申请人： Shen-En Qian ,  Hisham Othman

发明人： Shen-En Qian ,  Hisham Othman

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T5/10 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10032 ,  G06T2207/10036 ,  G06T2207/20064 ,  G06T2207/30181

摘要： Methods and systems for increasing the signal-to-noise ratio for satellite sensor data or signals, such as hyperspectral imageries (also referred to as datacubes due to their 3-dimensional nature). This is done by reducing the noise in the data or signals by first elevating the noise level temporarily for effective denoising. The denoising process is then performed in this condition and the noise level is then reversibly de-elevated after denoising. The denoising process comprises noise removal in both the spectral and the spatial domains. Once the denoising process is complete, the data is converted back from the spectral and spatial domains. Since this reconstruction process introduces errors, these errors are compensated for using the components from both the original data and denoised data filtered by the low pass filters.

摘要翻译： 用于增加卫星传感器数据或信号的信噪比的方法和系统，例如高光谱图像（由于其三维性质也称为数据采集器）。 这是通过首先提高噪声水平来降低数据或信号中的噪声来进行有效去噪。 然后在该条件下执行去噪处理，然后在去噪后可逆地去除噪声水平。 去噪过程包括在光谱和空间域中的噪声去除。 一旦去噪过程完成，数据将从光谱和空间域转换回来。 由于该重构过程引入了误差，所以使用来自原始数据的分量和由低通滤波器滤波的去噪数据来补偿这些误差。

公开(公告)号：US08107747B2

公开(公告)日：2012-01-31

申请号：US11812948

申请日：2007-06-22

申请人： Shen-En Qian ,  Allan B. Hollinger ,  Luc Gagnon

发明人： Shen-En Qian ,  Allan B. Hollinger ,  Luc Gagnon

IPC分类号： G06K9/36 ,  G06K9/46

CPC分类号： H04N19/94 ,  G01J3/2823 ,  H03M7/3082

摘要： The present invention relates to a real-time wideband compressor for multi-dimensional data. The compressor comprises a plurality of compression engines for simultaneously compressing a plurality of data subsets of a set of input data vectors and providing compressed data thereof using one of SAMVQ or HSOCVQ data compression. Each compression engine comprises an along spectral vectors codevector trainer as well as an across spectral bands codevector trainer. The compression engines are programmable to perform either along spectral vectors codevector training or across spectral bands codevector training in combination with one of the SAMVQ or HSOCVQ techniques without changing hardware. The compressor further comprises a network switch for partitioning the set of input data vectors into the plurality of data subsets, for providing each of the plurality of data subsets to one of the plurality of compression engines, and for transmitting the compressed data. The real-time wideband compressor is highly advantageous in, for example, space applications by programmable enabling performance of different techniques of codevector training as well as different techniques of VQ. Furthermore, after the compression process is started the compression process is performed autonomously without external communication.

摘要翻译： 本发明涉及用于多维数据的实时宽带压缩器。 压缩机包括多个压缩引擎，用于同时压缩一组输入数据向量的多个数据子集，并使用SAMVQ或HSOCVQ数据压缩之一提供其压缩数据。 每个压缩引擎包括沿着频谱矢量码矢量训练器以及跨频谱带码矢量训练器。 压缩引擎可编程为可以在不改变硬件的情况下，沿着频谱矢量码矢量训练或跨频谱频带编码矢量训练与SAMVQ或HSOCVQ技术中的一种进行组合。 该压缩器还包括网络交换机，用于将该组输入数据向量划分成多个数据子集，用于将多个数据子集中的每一个提供给多个压缩引擎中的一个，并用于发送压缩数据。 实时宽带压缩器在例如空间应用中通过可编程实现不同技术的码向量训练以及不同的VQ技术是非常有利的。 此外，在压缩处理开始之后，压缩处理在没有外部通信的情况下自主地执行。

公开(公告)号：US20110170796A1

公开(公告)日：2011-07-14

申请号：US12223283

申请日：2007-01-29

申请人： Shen-En Qian ,  Hisham Othman

发明人： Shen-En Qian ,  Hisham Othman

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T5/10 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10032 ,  G06T2207/10036 ,  G06T2207/20064 ,  G06T2207/30181

摘要： Methods and systems for increasing the signal-to-noise ratio for satellite sensor data or signals, such as hyperspectral imageries (also referred to as datacubes due to their 3-dimensional nature). This is done by reducing the noise in the data or signals by first elevating the noise level temporarily for effective denoising. The denoising process is then performed in this condition and the noise level is then reversibly de-elevated after denoising. The denoising process comprises noise removal in both the spectral and the spatial domains. Once the denoising process is complete, the data is converted back from the spectral and spatial domains. Since this reconstruction process introduces errors, these errors are compensated for using the components from both the original data and denoised data filtered by the low pass filters.

摘要翻译： 用于增加卫星传感器数据或信号的信噪比的方法和系统，例如高光谱图像（由于其三维性质也称为数据采集器）。 这是通过首先提高噪声水平来降低数据或信号中的噪声来进行有效去噪。 然后在该条件下执行去噪处理，然后在去噪后可逆地去除噪声水平。 去噪过程包括在光谱和空间域中的噪声去除。 一旦去噪过程完成，数据将从光谱和空间域转换回来。 由于该重构过程引入了误差，所以使用来自原始数据的分量和由低通滤波器滤波的去噪数据来补偿这些误差。

公开(公告)号：US20090279805A1

公开(公告)日：2009-11-12

申请号：US12453426

申请日：2009-05-11

申请人： Shen-En Qian ,  Allan B. Hollinger

发明人： Shen-En Qian ,  Allan B. Hollinger

IPC分类号： G06K9/36

CPC分类号： G06T9/008

摘要： Methods and systems for compressing a continuous data flow for numerous applications where it is necessary to process large data sets such as hyper-spectral data cubes in real-time. A predetermined number of 2D focal plane frames in a boundary area of a previous regional data cube close to a current regional data cube are included in a training set used for codevector training for the current region. Therefore, no artificial boundary occurs between the two adjacent regions when codevectors trained in this way are used for codebook generation and encoding of the spectral vectors of the current regional data cube. This process substantially reduces image artifacts between adjacent regions. A remedy for the single bit error problem is also provided. Full redundancy of compressed data for a regional data cube is obtained by combining a previous regional data cube and the current regional data cube for codebook training. In order to obtain redundancy for the index map, the codebook is used to encode the current regional data cube as well as the previous regional data cube producing a baseline index map for the current regional data cube and a redundant index map for the previous regional data cube. Therefore, full redundancy for a regional data cube is provided allowing restoration of a regional data cube even if its codebook and/or index map are corrupted or lost due to single bit errors.

摘要翻译： 用于压缩多个应用的​​连续数据流的方法和系统，其中需要实时处理诸如超光谱数据立方体之类的大数据集。 接近当前区域数据立方体的先前区域数据立方体的边界区域中的预定数量的2D焦平面帧被包括在用于当前区域的码矢量训练的训练集中。 因此，当以这种方式训练的代码矢量用于当前区域数据立方体的频谱矢量的码本生成和编码时，两个相邻区域之间不会发生人为边界。 该过程基本上减少相邻区域之间的图像伪像。 还提供了单位错误问题的补救措施。 通过组合先前的区域数据立方体和当前用于码本训练的区域数据立方体，获得区域数据立方体的压缩数据的完全冗余度。 为了获得索引图的冗余，码本用于对当前区域数据立方体以及以前的区域数据立方体进行编码，以生成当前区域数据立方体的基线索引图，以及用于先前区域数据的冗余索引图 立方体。 因此，提供区域数据立方体的完全冗余，允许恢复区域数据立方体，即使其码本和/或索引映射由于单个位错误而损坏或丢失。

公开(公告)号：US07551785B2

公开(公告)日：2009-06-23

申请号：US10611897

申请日：2003-07-03

申请人： Shen-En Qian ,  Allan B. Hollinger

发明人： Shen-En Qian ,  Allan B. Hollinger

IPC分类号： G06K9/36 ,  G06K9/00 ,  H04B1/66

CPC分类号： G06T9/008

摘要： The present invention relates to a method and system for compressing a continuous data flow in real-time based on lossy compression. In real-time data compression, a series of multi-dimensional data subsets acquired in a given period of time are treated as a regional data cube for the purpose of dividing a continuous series of data subsets into a plurality of data cubes. In a first embodiment implementation of parallel processing using a plurality of compression engines is facilitated by separating a data cube into a plurality of clusters comprising similar spectral vectors. By separating the data cube into clusters of similar spectral vectors no artificial spatial boundaries are introduced substantially improving image quality. Furthermore, the spectral vectors within a cluster are more easily compressed due to their similarity. In a second embodiment a predetermined number of 2D focal plane frames in a boundary area of a previous regional data cube close to a current regional data cube are included in a training set used for codevector training for the current region. Therefore, no artificial boundary occurs between the two adjacent regions when codevectors trained in this way are used for codebook generation and encoding of the spectral vectors of the current regional data cube substantially reducing image artifacts between adjacent regions. A remedy for the single bit error problem is provided in a third embodiment. Full redundancy of compressed data for a regional data cube is obtained by combining the previous regional data cube and the current regional data cube for codebook training. In order to obtain redundancy for the index map, the codebook is used to encode the current regional data cube as well as the previous regional data cube producing a baseline index map for the current regional data cube and a redundant index map for the previous regional data cube. Therefore, full redundancy for a regional data cube is provided allowing restoration of a regional data cube if its codebook and/or index map are corrupted or lost due to single bit errors.

公开(公告)号：US20050047670A1

公开(公告)日：2005-03-03

申请号：US10651110

申请日：2003-08-29

申请人： Shen-En Qian ,  Allan Hollinger ,  Luc Gagnon

发明人： Shen-En Qian ,  Allan Hollinger ,  Luc Gagnon

IPC分类号： G01J3/28 ,  G06F17/16 ,  G06K9/36 ,  H03M7/30

CPC分类号： H04N19/94 ,  G01J3/2823 ,  H03M7/3082

摘要： The present invention relates to a real-time wideband compressor for multi-dimensional data. The compressor comprises a plurality of compression engines for simultaneously compressing a plurality of data subsets of a set of input data vectors and providing compressed data thereof using one of SAMVQ or HSOCVQ data compression. Each compression engine comprises an along spectral vectors codevector trainer as well as an across spectral bands codevector trainer. The compression engines are programmable to perform either along spectral vectors codevector training or across spectral bands codevector training in combination with one of the SAMVQ or HSOCVQ techniques without changing hardware. The compressor further comprises a network switch for partitioning the set of input data vectors into the plurality of data subsets, for providing each of the plurality of data subsets to one of the plurality of compression engines, and for transmitting the compressed data. The real-time wideband compressor is highly advantageous in, for example, space applications by programmable enabling performance of different techniques of codevector training as well as different techniques of VQ. Furthermore, after the compression process is started the compression process is performed autonomously without external communication.

摘要翻译： 本发明涉及用于多维数据的实时宽带压缩器。 压缩机包括多个压缩引擎，用于同时压缩一组输入数据向量的多个数据子集，并使用SAMVQ或HSOCVQ数据压缩之一提供其压缩数据。 每个压缩引擎包括沿着频谱矢量码矢量训练器以及跨频谱带码矢量训练器。 压缩引擎可编程为可以在不改变硬件的情况下，沿着频谱矢量码矢量训练或跨频谱频带编码矢量训练与SAMVQ或HSOCVQ技术中的一种进行组合。 该压缩器还包括网络交换机，用于将该组输入数据向量划分成多个数据子集，用于将多个数据子集中的每一个提供给多个压缩引擎中的一个，并用于发送压缩数据。 实时宽带压缩器在例如空间应用中通过可编程实现不同技术的码向量训练以及不同的VQ技术是非常有利的。 此外，在压缩处理开始之后，压缩处理在没有外部通信的情况下自主地执行。

公开(公告)号：US20050002584A1

公开(公告)日：2005-01-06

申请号：US10611897

申请日：2003-07-03

申请人： Shen-En Qian ,  Allan Hollinger

发明人： Shen-En Qian ,  Allan Hollinger

IPC分类号： G06T9/00 ,  G10L19/12

CPC分类号： G06T9/008

摘要： The present invention relates to a method and system for compressing a continuous data flow in real-time based on lossy compression. In real-time data compression, a series of multi-dimensional data subsets acquired in a given period of time are treated as a regional data cube for the purpose of dividing a continuous series of data subsets into a plurality of data cubes. In a first embodiment implementation of parallel processing using a plurality of compression engines is facilitated by separating a data cube into a plurality of clusters comprising similar spectral vectors. By separating the data cube into clusters of similar spectral vectors no artificial spatial boundaries are introduced substantially improving image quality. Furthermore, the spectral vectors within a cluster are more easily compressed due to their similarity. In a second embodiment a predetermined number of 2D focal plane frames in a boundary area of a previous regional data cube close to a current regional data cube are included in a training set used for codevector training for the current region. Therefore, no artificial boundary occurs between the two adjacent regions when codevectors trained in this way are used for codebook generation and encoding of the spectral vectors of the current regional data cube substantially reducing image artifacts between adjacent regions. A remedy for the single bit error problem is provided in a third embodiment. Full redundancy of compressed data for a regional data cube is obtained by combining the previous regional data cube and the current regional data cube for codebook training. In order to obtain redundancy for the index map, the codebook is used to encode the current regional data cube as well as the previous regional data cube producing a baseline index map for the current regional data cube and a redundant index map for the previous regional data cube. Therefore, full redundancy for a regional data cube is provided allowing restoration of a regional data cube if its codebook and/or index map are corrupted or lost due to single bit errors.

公开(公告)号：US06701021B1

公开(公告)日：2004-03-02

申请号：US09717220

申请日：2000-11-22

申请人： Shen-En Qian ,  Allan B. Hollinger

发明人： Shen-En Qian ,  Allan B. Hollinger

IPC分类号： G06K9456

CPC分类号： H04N19/94 ,  G06T9/008

摘要： The present method relates to a method for encoding image data using vector quantization. According to the invention, a small first codebook is determined. Each image vector of the image data is then encoded by determining a codevector within the first codebook that best approximates the image vector within the image data. A first index map is generated by replacing each image vector with an index indicative of the codevector's location within the first codebook. Then difference data are evaluated based on the original image data and the encoded image data. Each error vector of the difference data is then encoded using another small codebook. In another index map the error vectors are then replaced with an index indicative of the codevector's location within the other codebook. Evaluation of the error based on the difference data and the encoded difference data provides new difference data which is used to evaluate the fidelity of the approximation process performed for compression. The steps of encoding of the difference data are repeated until a control error of the difference data is smaller than a given threshold.

摘要翻译： 本方法涉及使用矢量量化对图像数据进行编码的方法。 根据本发明，确定了小的第一码本。 然后通过确定最接近图像数据内的图像矢量的第一码本内的码矢来对图像数据的每个图像矢量进行编码。 通过用表示第一码本中的码矢量的位置的索引替换每个图像矢量来生成第一索引图。 然后基于原始图像数据和编码图像数据来评估差异数据。 然后使用另一个小码本对差数据的每个误差向量进行编码。 在另一个索引图中，然后用指示代码向量在另一码本内的位置的索引替换错误向量。 基于差分数据和编码的差分数据对误差的评估提供了用于评估对压缩执行的近似处理的保真度的新的差分数据。 重复差分数据的编码步骤，直到差分数据的控制误差小于给定的阈值。

公开(公告)号：US06546146B1

公开(公告)日：2003-04-08

申请号：US09182187

申请日：1998-10-30

申请人： Allan B. Hollinger ,  Shen-en Qian ,  Daniel J. Williams

发明人： Allan B. Hollinger ,  Shen-en Qian ,  Daniel J. Williams

IPC分类号： G06K936

CPC分类号： G06T9/008

摘要： The present invention relates to a method of viewing and processing hyper-spectral image data compressed using a VQ algorithm. According to the invention the data is compressed using a codebook of codevectors including binary spectral vectors, which allows processing of the compressed data and viewing of data within a datacube without expanding the compressed data into the complete datacube. In order to view an image derived from a datacube, for each pixel within the image a location within the datacube is selected, an index value from the index map at that location is retrieved, and a spectral value from a spectral vector within the codebook is retrieved for said pixel, the spectral vector identified by the retrieved index. A single spectral vector is easily viewed by displaying a spectral vector from the codebook.

摘要翻译： 本发明涉及一种使用VQ算法压缩的超光谱图像数据的查看和处理方法。 根据本发明，使用包括二进制频谱矢量在内的代码矢量码本对数据进行压缩，这允许压缩数据的处理和数据存储器内的数据的查看，而不将压缩的数据扩展到完整的数据存储器中。 为了查看从数据库导出的图像，对于图像内的每个像素，选择数据库内的位置，从该位置处的索引图中检索索引值，并且从码本内的频谱矢量的频谱值为 对于所述像素检索，由所检索的索引识别的频谱矢量。 通过从码本显示光谱矢量，可以容易地观看单个光谱矢量。

公开(公告)号：US07251376B2

公开(公告)日：2007-07-31

申请号：US10651110

申请日：2003-08-29

申请人： Shen-En Qian ,  Allan B. Hollinger ,  Luc Gagnon

发明人： Shen-En Qian ,  Allan B. Hollinger ,  Luc Gagnon

IPC分类号： G06K9/36 ,  G06K9/46

CPC分类号： H04N19/94 ,  G01J3/2823 ,  H03M7/3082

摘要： The present invention relates to a real-time wideband compressor for multi-dimensional data. The compressor comprises a plurality of compression engines for simultaneously compressing a plurality of data subsets of a set of input data vectors and providing compressed data thereof using one of SAMVQ or HSOCVQ data compression. Each compression engine comprises an along spectral vectors codevector trainer as well as an across spectral bands codevector trainer. The compression engines are programmable to perform either along spectral vectors codevector training or across spectral bands codevector training in combination with one of the SAMVQ or HSOCVQ techniques without changing hardware. The compressor further comprises a network switch for partitioning the set of input data vectors into the plurality of data subsets, for providing each of the plurality of data subsets to one of the plurality of compression engines, and for transmitting the compressed data. The real-time wideband compressor is highly advantageous in, for example, space applications by programmable enabling performance of different techniques of codevector training as well as different techniques of VQ. Furthermore, after the compression process is started the compression process is performed autonomously without external communication.

摘要翻译： 本发明涉及用于多维数据的实时宽带压缩器。 压缩机包括多个压缩引擎，用于同时压缩一组输入数据向量的多个数据子集，并使用SAMVQ或HSOCVQ数据压缩之一提供其压缩数据。 每个压缩引擎包括沿着频谱矢量码矢量训练器以及跨频谱带码矢量训练器。 压缩引擎可编程为可以在不改变硬件的情况下，沿着频谱矢量码矢量训练或跨频谱频带编码矢量训练与SAMVQ或HSOCVQ技术中的一种进行组合。 该压缩器还包括网络交换机，用于将该组输入数据向量划分成多个数据子集，用于将多个数据子集中的每一个提供给多个压缩引擎中的一个，并用于发送压缩数据。 实时宽带压缩器在例如空间应用中通过可编程实现不同技术的码向量训练以及不同的VQ技术是非常有利的。 此外，在压缩处理开始之后，压缩处理在没有外部通信的情况下自主地执行。