HARDWARE EFFICIENT RABIN FINGERPRINTS
    2.
    发明公开
    HARDWARE EFFICIENT RABIN FINGERPRINTS 审中-公开
    硬件高效的RABIN指纹

    公开(公告)号:EP3051699A2

    公开(公告)日:2016-08-03

    申请号:EP16153014.2

    申请日:2016-01-27

    IPC分类号: H03M7/30

    摘要: An approach for fingerprinting large data objects at the wire speed has been disclosed. The techniques include Fresh/Shift pipelining, split Fresh, optimization, online channel sampling, and pipelined selection. The architecture can also be replicated to work in parallel for higher system throughput. Fingerprinting may provide an efficient mechanism for identifying duplication in a data stream, and deduplication based on the identified fingerprints may provide reduced storage costs, reduced network bandwidth consumption, reduced processing time and other benefits. In some embodiments, fingerprinting may be used to ensure or verify data integrity and may facilitate detection of corruption or tampering. An efficient manner of generating fingerprints (either via hardware, software, or a combination) may reduce a computation load and/or time required to generate fingerprints.

    摘要翻译: 已经公开了以线速度对大数据对象进行指纹识别的方法。 这些技术包括新鲜/移位流水线,拆分新鲜,优化,在线通道采样和流水线选择。 该架构还可以被复制并行工作以获得更高的系统吞吐量。 指纹识别可以提供用于识别数据流中的重复的有效机制,并且基于识别的指纹的重复数据删除可以提供降低的存储成本,减少的网络带宽消耗,减少的处理时间和其他好处。 在一些实施例中,指纹识别可以用于确保或验证数据完整性并且可以便于检测损坏或篡改。 产生指纹(通过硬件,软件或组合)的有效方式可以减少产生指纹所需的计算负荷和/或时间。

    ENCODING PROGRAM, ENCODING METHOD, ENCODING DEVICE, DECODING PROGRAM, DECODING METHOD, AND DECODING DEVICE
    4.
    发明公开
    ENCODING PROGRAM, ENCODING METHOD, ENCODING DEVICE, DECODING PROGRAM, DECODING METHOD, AND DECODING DEVICE 审中-公开
    CODIERUNGSPROGRAMM,CODIERUNGSVERFAHREN,CODIERUNGSVORRICHTUNG,DECODIERUNGSPROGRAMM,DECODIERUNGSVERFAHREN,DECODIERUNGSVORRICHTUNG

    公开(公告)号:EP3154202A1

    公开(公告)日:2017-04-12

    申请号:EP16192341.2

    申请日:2016-10-05

    申请人: FUJITSU LIMITED

    发明人: Kataoka, Masahiro

    IPC分类号: H03M7/30 H03M7/40

    摘要: An encoding device(100a) generates static-encoded data from input text data, utilizing a static dictionary that associates a character strings and static codes, respectively the static-encoded data including a plurality of static codes corresponding to a plurality of character strings that are registered in the static dictionary, generates dynamic-encoded data from the static-encoded data by encoding a character string or the static code that occurs more than once in the static-encodes data into a dynamic code, creates a dynamic dictionary associating character strings or static codes with corresponding dynamic codes, respectively and creates a Huffman tree and data of a leaf in the Huffman tree based on an occurrence frequency of the dynamic codes and the static codes in the input text data.

    摘要翻译: 编码装置(100a)从输入的文本数据生成静态编码数据,利用静态字典分别将字符串和静态代码相关联,静态编码数据包括对应于多个字符串的多个静态代码 在静态字典中注册,通过将静态编码数据中多次出现的字符串或静态代码编码为动态代码,从静态编码数据生成动态编码数据,创建关联字符串的动态字典或 根据动态代码的出现频率和输入文本数据中的静态代码,分别创建霍夫曼树和霍夫曼树中叶片的数据。

    DATA COMPRESSION AND DECOMPRESSION USING SIMD INSTRUCTIONS
    5.
    发明公开
    DATA COMPRESSION AND DECOMPRESSION USING SIMD INSTRUCTIONS 审中-公开
    DATENKOMPRESSION DERKOMPRESSION DURCH SIMD-BEFEHLE

    公开(公告)号:EP2949047A1

    公开(公告)日:2015-12-02

    申请号:EP14743594.5

    申请日:2014-01-22

    IPC分类号: H03M13/27 G06F9/38

    摘要: Compression and decompression of numerical data utilizing single instruction, multiple data (SIMD) instructions is described. The numerical data includes integer and floating-point samples. Compression supports three encoding modes: lossless, fixed-rate, and fixed-quality. SIMD instructions for compression operations may include attenuation, derivative calculations, bit packing to form compressed packets, header generation for the packets, and packed array output operations. SIMD instructions for decompression may include packed array input operations, header recovery, decoder control, bit unpacking, integration, and amplification. Compression and decompression may be implemented in a microprocessor, digital signal processor, field-programmable gate array, application-specific integrated circuit, system-on-chip, or graphics processor, using SIMD instructions. Compression and decompression of numerical data can reduce memory, networking, and storage bottlenecks. This abstract does not limit the scope of the invention as described in the claims.

    摘要翻译: 描述使用单指令,多数据(SIMD)指令对数值数据的压缩和解压缩。 数值数据包括整数和浮点样本。 压缩支持三种编码模式:无损,固定速率和固定质量。 用于压缩操作的SIMD指令可以包括衰减,微分计算,位打包以形成压缩分组,分组的报头生成以及打包阵列输出操作。 用于解压缩的SIMD指令可以包括打包阵列输入操作,报头恢复,解码器控制,比特解包,集成和放大。 压缩和解压缩可以使用SIMD指令在微处理器,数字信号处理器,现场可编程门阵列,专用集成电路,片上系统或图形处理器中实现。 数字数据的压缩和解压缩可以减少内存,网络和存储瓶颈。 该摘要并不限制如权利要求中所述的本发明的范围。

    HARDWARE EFFICIENT RABIN FINGERPRINTS
    8.
    发明公开
    HARDWARE EFFICIENT RABIN FINGERPRINTS 审中-公开
    硬件高效RABIN指纹

    公开(公告)号:EP3051699A3

    公开(公告)日:2016-08-17

    申请号:EP16153014.2

    申请日:2016-01-27

    IPC分类号: H03M7/30

    摘要: An approach for fingerprinting large data objects at the wire speed has been disclosed. The techniques include Fresh/Shift pipelining, split Fresh, optimization, online channel sampling, and pipelined selection. The architecture can also be replicated to work in parallel for higher system throughput. Fingerprinting may provide an efficient mechanism for identifying duplication in a data stream, and deduplication based on the identified fingerprints may provide reduced storage costs, reduced network bandwidth consumption, reduced processing time and other benefits. In some embodiments, fingerprinting may be used to ensure or verify data integrity and may facilitate detection of corruption or tampering. An efficient manner of generating fingerprints (either via hardware, software, or a combination) may reduce a computation load and/or time required to generate fingerprints.

    COMPRESSION DE DONNEES NUMERIQUES
    9.
    发明公开

    公开(公告)号:EP3391545A1

    公开(公告)日:2018-10-24

    申请号:EP16809848.1

    申请日:2016-12-15

    IPC分类号: H03M7/30

    CPC分类号: H03M7/6029 H03M7/3077

    摘要: Method for compressing digital data, characterised in that it comprises the steps of: extrapolating (E11) the value of each sample of data to be compressed (EC
    n ) as a function of the value of at least one preceding sample, in order to produce an extrapolated sample (EE
    n ), differentiating (E12) between each extrapolated sample and the corresponding sample of data to be compressed, in order to produce a differentiated sample (ED
    n ), and deleting (E13) redundancy between successive differentiated samples produced by the differentiating stage.

    ENTROPY ENCODING AND DECODING SCHEME

    公开(公告)号:EP2614592B1

    公开(公告)日:2018-06-27

    申请号:EP10752348.2

    申请日:2010-09-09

    IPC分类号: H03M7/40 H03M7/30 H03M7/42

    摘要: In PIPE coding, where alphabet symbols are distributed among a plurality of specialized entropy en/decoders according to their probability distribution estimate, a categorizing stage is provided where source symbols to be encoded are sub-divided into a first substream which is subject to VLC coding, and a second substream which is subject to PIPE coding. By this measure, source symbols having an appropriate symbol probability distribution, i.e. a probability distribution suitable for being efficiently coded by means of VLC coding without the deficiencies outlined above in the introductory portion of the specification of the present application, may be categorized as VLC coded symbols whereas other symbols may be treated as PIPE coded symbols and subject to PIPE coding, the coding complexity of which is higher than VLC coding, but at a better compression efficiency.