HARDWARE DATA COMPRESSOR USING DYNAMIC HASH ALGORITHM BASED ON INPUT BLOCK TYPE
    1.
    发明申请
    HARDWARE DATA COMPRESSOR USING DYNAMIC HASH ALGORITHM BASED ON INPUT BLOCK TYPE 有权
    使用基于输入块类型的动态哈希算法的硬件数据压缩器

    公开(公告)号:US20160336962A1

    公开(公告)日:2016-11-17

    申请号:US14883106

    申请日:2015-10-14

    IPC分类号: H03M7/42 H03M7/30

    摘要: A hardware data compressor that compresses an input block of characters by replacing strings of characters in the input block with back pointers to matching strings earlier in the input block. A hash table is used in searching for the matching strings in the input block. A plurality of hash index generators each employs a different hashing algorithm on an initial portion of the strings of characters to be replaced to generate a respective index. The hardware data compressor also includes an indication of a type of the input block of characters. A selector selects the index generated by of one of the plurality hash index generators to index into the hash table based on the type of the input block.

    摘要翻译: 硬件数据压缩器,其通过用输入块之前的匹配字符串的后向指针替换输入块中的字符串来压缩输入的字符块。 哈希表用于搜索输入块中的匹配字符串。 多个散列索引生成器各自在要替换的字符串的初始部分上采用不同的散列算法以生成相应的索引。 硬件数据压缩器还包括字符的输入块的类型的指示。 选择器根据输入块的类型选择由多个散列索引发生器之一生成的索引以索引到哈希表中。

    Variable Frequency Data Transmission
    2.
    发明申请
    Variable Frequency Data Transmission 有权
    变频数据传输

    公开(公告)号:US20150382352A1

    公开(公告)日:2015-12-31

    申请号:US14846424

    申请日:2015-09-04

    申请人: Cyborg Inc.

    IPC分类号: H04W72/04 H04B1/40 H03M7/30

    摘要: A system is disclosed comprising a transceiver, transcoder, memory, and a processor for receiving raw data, partitioning the raw data into substrings of predetermined length, assigning each substring to a corresponding predetermined frequency based upon a data set or first lookup table based on the substring's given pattern, and transmitting said frequency using an antenna. Embodiments include a compression component for receiving raw data as input, breaking the raw data into subsets of predetermined length, comparing the raw data to a second lookup table, the second lookup table comprising all possible bit patterns for a file of the length of the raw data, wherein the possible bit patterns are partitioned in n-bit partitions, the n-bit partitions having a corresponding assigned value, the values of which are assembled by a given function so as to produce a code for each possible bit pattern.

    摘要翻译: 公开了一种系统,包括收发器,代码转换器,存储器和处理器,用于接收原始数据,将原始数据划分成预定长度的子串,基于基于数据集或第一查找表将每个子字符串分配给相应的预定频率 子串的给定模式,并使用天线发送所述频率。 实施例包括用于接收原始数据作为输入的压缩组件,将原始数据分解成预定长度的子集,将原始数据与第二查找表进行比较,第二查找表包括原始数据长度的文件的所有可能位模式 数据,其中可能的位模式在n位分区中分区,n位分区具有相应的分配值,其值由给定的功能组合,以便产生每个可能的位模式的代码。

    Processing system and method including data compression API
    3.
    发明授权
    Processing system and method including data compression API 有权
    处理系统和方法包括数据压缩API

    公开(公告)号:US09158686B2

    公开(公告)日:2015-10-13

    申请号:US13616898

    申请日:2012-09-14

    申请人: Albert W. Wegener

    发明人: Albert W. Wegener

    摘要: Memory system operations are extended for a data processor by an application programming interface API, including a set of operations and parameters for the operations, which provides for data compression and decompression during or in conjunction with processes for moving data between memory elements of the memory system. The set of operations can be configured to use the parameters and perform the operations of the API. The API can support moves between memory having a first access latency, such as memory integrated on the same chip as a processor core, and memory having a second access latency that is longer than the first access latency, such as memory on a different integrated circuit than the processor core.

    摘要翻译: 存储器系统操作通过应用程序编程接口API对数据处理器进行扩展,包括用于操作的一组操作和参数,该操作和参数在存储器系统的存储器元件之间或之间移动数据的过程期间提供数据压缩和解压缩 。 可以将该组操作配置为使用参数并执行API的操作。 API可以支持具有第一访问延迟的存储器之间的移动,诸如与处理器核心在同一芯片上集成的存储器,以及具有比第一访问延迟更长的第二访问延迟的存储器,例如不同集成电路上的存储器 比处理器核心。

    DATA RECORD COMPRESSION WITH PROGRESSIVE AND/OR SELECTIVE DECOMPOSITION
    4.
    发明申请
    DATA RECORD COMPRESSION WITH PROGRESSIVE AND/OR SELECTIVE DECOMPOSITION 有权
    具有渐进和/或选择性分解的数据记录压缩

    公开(公告)号:US20150234899A1

    公开(公告)日:2015-08-20

    申请号:US14703622

    申请日:2015-05-04

    申请人: QBASE, LLC

    IPC分类号: G06F17/30

    摘要: Disclosed herein are systems and methods for compressing structured or semi-structured data in a horizontal manner achieving compression ratios similar to vertical compression. Collections include structured or semi-structured data include a number of fields and are described using a schema. Fields include information having semantic similarity and are compressed using methods suitable for compressing the type of data. Data of a collection is compressed after fragmentation or may be normalized prior to compression. Data with semantic similarity is compressed using token tables and/or n-gram tables, where higher weighted, consisting of the product of frequency and length, occurring values may be stored in the lower numbered indices of the data table. Records include record descriptor bytes, field descriptor bytes, zero or more array descriptor bytes, zero or more object descriptor bytes, or bytes representing the data associated with the record. Data is indexed or compressed by a suitable module.

    摘要翻译: 本文公开了用于以水平方式压缩结构化或半结构化数据的系统和方法,其实现类似于垂直压缩的压缩比。 集合包括结构化或半结构化数据包括多个字段,并使用模式进行描述。 字段包括具有语义相似性的信息,并使用适合于压缩数据类型的方法进行压缩。 集合的数据在分段之后被压缩,或者可以在压缩之前被归一化。 使用令牌表和/或n-gram表压缩具有语义相似性的数据,其中由频率和长度的乘积组成的较高加权可以存储在数据表的较低编号的索引中。 记录包括记录描述符字节,字段描述符字节,零个或多个数组描述符字节,零个或多个对象描述符字节或表示与记录相关联的数据的字节。 数据由合适的模块索引或压缩。

    SYSTEM AND METHOD FOR CONTENT-AWARE DATA COMPRESSION
    5.
    发明申请
    SYSTEM AND METHOD FOR CONTENT-AWARE DATA COMPRESSION 审中-公开
    用于内容数据压缩的系统和方法

    公开(公告)号:US20150227540A1

    公开(公告)日:2015-08-13

    申请号:US14178924

    申请日:2014-02-12

    申请人: HITACHI, LTD.

    IPC分类号: G06F17/30

    摘要: Exemplary embodiments provide a data compression technique which chooses a compression method without compressing data. A storage system comprises a storage media and a controller. The controller is operable to: determine a compression method to be used to compress a data block of uncompressed data based on one or more characteristics of data content of the uncompressed data prior to compressing the data block; and compress the data block of the uncompressed data using the determined compression method. In some embodiments, the controller is operable to determine the compression method based on a compression rule which relates one or more characteristics of data content and compression methods. In specific embodiments, the storage system further comprises a flash memory device which includes the controller to determine the compression method and to compress the data block.

    摘要翻译: 示例性实施例提供了在不压缩数据的情况下选择压缩方法的数据压缩技术。 存储系统包括存储介质和控制器。 所述控制器可操作以:在压缩所述数据块之前,基于所述未压缩数据的数据内容的一个或多个特征,确定要用于压缩未压缩数据的数据块的压缩方法; 并使用确定的压缩方法压缩未压缩数据的数据块。 在一些实施例中,控制器可操作以基于涉及数据内容和压缩方法的一个或多个特性的压缩规则来确定压缩方法。 在具体实施例中,存储系统还包括闪速存储器设备,其包括用于确定压缩方法并压缩数据块的控制器。

    System and method for adaptive compression
    6.
    发明授权
    System and method for adaptive compression 有权
    自适应压缩的系统和方法

    公开(公告)号:US08949466B1

    公开(公告)日:2015-02-03

    申请号:US13369002

    申请日:2012-02-08

    IPC分类号: G06F15/16

    摘要: Methods and systems are disclosed for adaptive compression is disclosed. The compression is adaptive based on one or more criteria related to the system, including but not limited to: the centralized authority, one or more remote devices, the communication channel, and/or the data communicated. For example, the compression may be adaptive based on one or more criteria related to the remote device, including dynamic and/or static criteria of the remote device. In this way, the adaptive compression may be reduce the amount of data transmitted from the remote device to the centralized authority, thereby conserving bandwidth.

    摘要翻译: 公开了用于自适应压缩的方法和系统。 基于与系统相关的一个或多个标准,压缩是自适应的,包括但不限于:集中式权限,一个或多个远程设备,通信信道和/或所传送的数据。 例如,压缩可以是基于与远程设备相关的一个或多个标准的自适应的,包括远程设备的动态和/或静态标准。 以这种方式,自适应压缩可以减少从远程设备向中央授权机构发送的数据量,从而节省带宽。

    Real-time multi-block lossless recompression
    7.
    发明授权
    Real-time multi-block lossless recompression 有权
    实时多块无损重新压缩

    公开(公告)号:US08566477B2

    公开(公告)日:2013-10-22

    申请号:US13282987

    申请日:2011-10-27

    IPC分类号: G06F15/16

    摘要: Exemplary methods, computer systems, and computer program products for processing a previously compressed data stream in a computer environment are provided. In one embodiment, the computer environment is configured for separating a previously compressed data stream into an input data block including a header input block having a previously compressed header. Sequences of bits are included with the input data block. Compression scheme information is derived from the previously compressed header. The input data block is accessed and recompressed following the header input block in the previously compressed data stream one at a time using block-image synchronization information. Access to the block-image synchronization information is initialized by the compression scheme information to generate an output data block. The block-image synchronization information is used to provide decompression information to facilitate decompression of the results of the output data block.

    摘要翻译: 提供了用于在计算机环境中处理先前压缩的数据流的示例性方法,计算机系统和计算机程序产品。 在一个实施例中,计算机环境被配置为将先前压缩的数据流分离成包括具有先前压缩的报头的报头输入块的输入数据块。 位的序列包含在输入数据块中。 压缩方案信息是从先前压缩的报头导出的。 在先前压缩的数据流中的标题输入块之后,使用块图像同步信息一次一个地访问和重新压缩输入数据块。 通过压缩方案信息初始化对块图像同步信息的访问,以生成输出数据块。 块图像同步信息用于提供解压缩信息以便于解压缩输出数据块的结果。

    PROCESSING SYSTEM AND METHOD INCLUDING DATA COMPRESSION API
    8.
    发明申请
    PROCESSING SYSTEM AND METHOD INCLUDING DATA COMPRESSION API 有权
    包括数据压缩API的处理系统和方法

    公开(公告)号:US20130262809A1

    公开(公告)日:2013-10-03

    申请号:US13616898

    申请日:2012-09-14

    申请人: ALBERT W. WEGENER

    发明人: ALBERT W. WEGENER

    IPC分类号: G06F12/02

    摘要: Memory system operations are extended for a data processor by an application programming interface API, including a set of operations and parameters for the operations, which provides for data compression and decompression during or in conjunction with processes for moving data between memory elements of the memory system. The set of operations can be configured to use the parameters and perform the operations of the API. The API can support moves between memory having a first access latency, such as memory integrated on the same chip as a processor core, and memory having a second access latency that is longer than the first access latency, such as memory on a different integrated circuit than the processor core.

    摘要翻译: 存储器系统操作通过应用程序编程接口API对数据处理器进行扩展,包括用于操作的一组操作和参数,该操作和参数在存储器系统的存储器元件之间或之间移动数据的过程期间提供数据压缩和解压缩 。 可以将该组操作配置为使用参数并执行API的操作。 API可以支持具有第一访问延迟的存储器之间的移动,诸如与处理器核心在同一芯片上集成的存储器,以及具有比第一访问延迟更长的第二访问延迟的存储器,例如不同集成电路上的存储器 比处理器核心。

    Managing telemetry bandwidth and security
    9.
    发明授权
    Managing telemetry bandwidth and security 有权
    管理遥测带宽和安全性

    公开(公告)号:US08184691B1

    公开(公告)日:2012-05-22

    申请号:US11496163

    申请日:2006-07-31

    IPC分类号: H04N7/12

    摘要: An encryption and authentication technique that achieves enhanced integrity verification through assured error-propagation using a multistage sequence of pseudorandom permutations. The present invention generates intermediate data-dependent cryptographic variables at each stage, which are systematically combined into feedback loops. The encryption technique also generates an authentication tag without any further steps that is N times longer than the block size where N is the number of pseudorandom permutations used in the encipherment of each block. The authentication tag provides a unique mapping to the plaintext for any number of plaintext blocks that is less than or equal to N. In addition to being a stand alone encryption algorithm, the disclosed technique is applicable to any mode that uses pseudorandom permutations such as, key dependent lookup tables, S-Boxes, and block ciphers such as RC5, TEA, and AES.

    摘要翻译: 一种加密和认证技术,通过使用伪随机排列的多级序列通过可靠的错误传播实现增强的完整性验证。 本发明在每个阶段生成中间数据相关的密码变量,它们被系统地组合成反馈回路。 加密技术还产生认证标签,而没有任何比块大小N倍长的其他步骤,其中N是在每个块的加密中使用的伪随机排列数。 认证标签提供对于小于或等于N的任意数量的明文块的明文的唯一映射。除了是独立的加密算法之外,所公开的技术也可应用于使用伪随机排列的任何模式, 密钥依赖查找表,S盒和块密码,如RC5,TEA和AES。

    DATA TRANSMISSION METHOD AND APPARATUS
    10.
    发明申请

    公开(公告)号:US20180262590A1

    公开(公告)日:2018-09-13

    申请号:US15979951

    申请日:2018-05-15

    IPC分类号: H04L29/08 G06F17/30 H03M7/30

    摘要: Embodiments of the present invention relate to the database field, and in particular, to a data transmission method and apparatus, so as to reduce overheads for data transmission between nodes in a distributed database and lighten network load. In the embodiments of the present invention, a DN determines a column that has a distribution rule of parameters in the column; the DN determines, according to a data type of the parameters of the column and the distribution rule of the parameters in the column, a compression algorithm corresponding to the column; the DN compresses the column using the compression algorithm; and the DN sends a compressed column to a target node. In this way, the overheads for the data transmission between the nodes are reduced, and the network load is lightened.