Real-time multi-block lossless recompression
    1.
    发明授权
    Real-time multi-block lossless recompression 有权
    实时多块无损重新压缩

    公开(公告)号:US08566477B2

    公开(公告)日:2013-10-22

    申请号:US13282987

    申请日:2011-10-27

    IPC分类号: G06F15/16

    摘要: Exemplary methods, computer systems, and computer program products for processing a previously compressed data stream in a computer environment are provided. In one embodiment, the computer environment is configured for separating a previously compressed data stream into an input data block including a header input block having a previously compressed header. Sequences of bits are included with the input data block. Compression scheme information is derived from the previously compressed header. The input data block is accessed and recompressed following the header input block in the previously compressed data stream one at a time using block-image synchronization information. Access to the block-image synchronization information is initialized by the compression scheme information to generate an output data block. The block-image synchronization information is used to provide decompression information to facilitate decompression of the results of the output data block.

    摘要翻译: 提供了用于在计算机环境中处理先前压缩的数据流的示例性方法,计算机系统和计算机程序产品。 在一个实施例中,计算机环境被配置为将先前压缩的数据流分离成包括具有先前压缩的报头的报头输入块的输入数据块。 位的序列包含在输入数据块中。 压缩方案信息是从先前压缩的报头导出的。 在先前压缩的数据流中的标题输入块之后,使用块图像同步信息一次一个地访问和重新压缩输入数据块。 通过压缩方案信息初始化对块图像同步信息的访问,以生成输出数据块。 块图像同步信息用于提供解压缩信息以便于解压缩输出数据块的结果。

    Real-time multi-block lossless recompression
    2.
    发明授权
    Real-time multi-block lossless recompression 有权
    实时多块无损重新压缩

    公开(公告)号:US08898337B2

    公开(公告)日:2014-11-25

    申请号:US13282991

    申请日:2011-10-27

    摘要: Exemplary methods, computer systems, and computer program products for processing a previously compressed data stream in a computer environment are provided. In one embodiment, the computer environment is configured for separating a previously compressed data stream into an input data block including a header input block having a previously compressed header. Sequences of bits are included with the input data block. Compression scheme information is derived from the previously compressed header. The input data block is accessed and recompressed following the header input block in the previously compressed data stream one at a time using block-image synchronization information. Access to the block-image synchronization information is initialized by the compression scheme information to generate an output data block. The block-image synchronization information is used to provide decompression information to facilitate decompression of the results of the output data block.

    摘要翻译: 提供了用于在计算机环境中处理先前压缩的数据流的示例性方法,计算机系统和计算机程序产品。 在一个实施例中,计算机环境被配置为将先前压缩的数据流分离成包括具有先前压缩的报头的报头输入块的输入数据块。 位的序列包含在输入数据块中。 压缩方案信息是从先前压缩的报头导出的。 在先前压缩的数据流中的标题输入块之后,使用块图像同步信息一次一个地访问和重新压缩输入数据块。 通过压缩方案信息初始化对块图像同步信息的访问,以生成输出数据块。 块图像同步信息用于提供解压缩信息以便于解压缩输出数据块的结果。

    Real-time image compression
    3.
    发明授权
    Real-time image compression 失效
    实时图像压缩

    公开(公告)号:US08682091B2

    公开(公告)日:2014-03-25

    申请号:US13213023

    申请日:2011-08-18

    IPC分类号: G06K9/36 G06K9/46

    CPC分类号: H04N19/40 H04N19/91

    摘要: Exemplary method, system, and computer program product embodiments for real-time image recompression are provided. In one embodiment, by way of example only, compressed segments that are identified as having used at least one of a plurality of inefficient compression operations are partially decoded. The compressed segments are recompressed by employing context mapping. Additional system and computer program product embodiments are disclosed and provide related advantages.

    摘要翻译: 提供了用于实时图像重新压缩的示例性方法,系统和计算机程序产品实施例。 在一个实施例中,仅作为示例,被识别为已经使用多个低效压缩操作中的至少一个的压缩段被部分解码。 压缩段通过使用上下文映射来重新压缩。 公开了附加的系统和计算机程序产品实施例并提供相关的优点。

    Real-time multi-block lossless recompression

    公开(公告)号:US08578058B2

    公开(公告)日:2013-11-05

    申请号:US13044396

    申请日:2011-03-09

    IPC分类号: G06F15/16

    摘要: Exemplary methods, computer systems, and computer program products for processing a previously compressed data stream in a computer environment are provided. In one embodiment, the computer environment is configured for separating a previously compressed data stream into an input data block including a header input block having a previously compressed header. Sequences of bits are included with the input data block. Compression scheme information is derived from the previously compressed header. The input data block is accessed and recompressed following the header input block in the previously compressed data stream one at a time using block-image synchronization information. Access to the block-image synchronization information is initialized by the compression scheme information to generate an output data block. The block-image synchronization information is used to provide decompression information to facilitate decompression of the results of the output data block.

    Efficiently storing and retrieving data and metadata
    5.
    发明授权
    Efficiently storing and retrieving data and metadata 有权
    有效地存储和检索数据和元数据

    公开(公告)号:US08805855B2

    公开(公告)日:2014-08-12

    申请号:US13588292

    申请日:2012-08-17

    申请人: Ben Sasson Ori Shalev

    发明人: Ben Sasson Ori Shalev

    IPC分类号: G06F17/30

    摘要: For efficiently storing and retrieving data and metadata in phases, in a first phase, metadata tokens, which are assigned to most active metadata-emitting entities, are used for storing the data and the metadata together in a single input/output operation while piggybacking the metadata of least active metadata-emitting entities onto one of the most active metadata-emitting entities having one of the metadata tokens. In a second phase, the metadata is re-written to a metadata delta journal for reclaiming the metadata tokens. In a third phase, the metadata journal is applied to a metadata structure containing the metadata of the storage system, the metadata delta journal is then cleared after successfully updating the main metadata structure with the metadata of the metadata journal. The metadata journal is swapped with an empty metadata journal for concurrently adding metadata while retaining the metadata journal until applying the metadata delta journal to the metadata structure.

    摘要翻译: 为了分阶段地有效地存储和检索数据和元数据,在第一阶段中,分配给最活跃的元数据发射实体的元数据令牌被用于将数据和元数据一起存储在单个输入/输出操作中,同时 将最不活跃的元数据发射实体的元数据发送到具有元数据令牌之一的最活跃的元数据发射实体之一上。 在第二阶段,将元数据重新写入到元数据增量杂志中以回收元数据令牌。 在第三阶段,元数据日记应用于包含存储系统的元数据的元数据结构,然后在使用元数据日志的元数据成功更新主元数据结构之后,元数据增量日志将被清除。 元数据日志与一个空的元数据日志交换,用于同时添加元数据,同时保留元数据日志,直到将元数据增量日志应用到元数据结构。

    METHOD AND SYSTEM FOR COMPRESSION OF LOGICAL DATA OBJECTS FOR STORAGE
    6.
    发明申请
    METHOD AND SYSTEM FOR COMPRESSION OF LOGICAL DATA OBJECTS FOR STORAGE 有权
    用于存储的逻辑数据对象的压缩方法和系统

    公开(公告)号:US20100277353A1

    公开(公告)日:2010-11-04

    申请号:US12773131

    申请日:2010-05-04

    IPC分类号: H03M13/00

    CPC分类号: H03M7/30

    摘要: There is provided a compression system configured to compress logical data objects into one or more accommodation blocks with a predefined size, and a method of operating thereof. The compression system comprises a compression engine capable of compressing input data with the help of sequential encoding one or more input strings and a counter operatively coupled to the compression engine. The counter is configured to keep its ongoing value indicative of a number of input bytes in one or more strings successfully encoded into a given accommodation block; and, responsive to unsuccessful compression of a string into the given accommodation block, to provide the compression engine with information indicative of starting point in the input stream for encoding into the next accommodation block, thus giving rise to a “start indication”.

    摘要翻译: 提供了一种被配置为将逻辑数据对象压缩成具有预定义大小的一个或多个容纳块的压缩系统及其操作方法。 压缩系统包括能够借助于顺序编码一个或多个输入串和可操作地耦合到压缩引擎的计数器来压缩输入数据的压缩引擎。 该计数器被配置为保持其持续值表示一个或多个成功地编码到给定住宿块中的字符串中的输入字节数; 并且响应于将字符串不成功地压缩到给定的调节块中,以向压缩引擎提供指示用于编码到下一个调节块中的输入流中的起始点的信息,从而产生“开始指示”。

    Methods and apparatus to implement parallel transactions
    7.
    发明授权
    Methods and apparatus to implement parallel transactions 有权
    实现并行交易的方法和设备

    公开(公告)号:US07669015B2

    公开(公告)日:2010-02-23

    申请号:US11475814

    申请日:2006-06-27

    IPC分类号: G06F12/00

    摘要: The present disclosure describes a unique way for each of multiple processes to operate in parallel using (e.g., reading, modifying, and writing to) the same shared data without causing corruption to the shared data. For example, each of multiple processes utilizes current and past data values associated with a global counter or clock for purposes of determining whether any shared variables used to produce a respective transaction outcome were modified (by another process) when executing a respective transaction. If a respective process detects that shared data used by respective process was modified during a transaction, the process can abort and retry the transaction rather than cause data corruption by storing locally maintained results associated with the transaction to a globally shared data space.

    摘要翻译: 本公开描述了使用(例如,读取,修改和写入)相同的共享数据而不会对共享数据造成损坏的多个进程中的每一个进行并行操作的独特方式。 例如,当执行相应的交易时,多个过程中的每个利用与全局计数器或时钟相关联的当前和过去的数据值来确定用于产生相应的交易结果的任何共享变量(通过另一个进程)被修改。 如果相应的进程检测到在处理期间修改了相应进程使用的共享数据,则该进程可以中止并重试事务,而不是通过将与事务相关联的本地维护的结果存储到全局共享的数据空间来导致数据损坏。

    Methods and apparatus to implement parallel transactions
    8.
    发明申请
    Methods and apparatus to implement parallel transactions 有权
    实现并行交易的方法和设备

    公开(公告)号:US20070239943A1

    公开(公告)日:2007-10-11

    申请号:US11699802

    申请日:2007-01-30

    IPC分类号: G06F12/00

    CPC分类号: G06F9/466

    摘要: The present disclosure describes a unique way for each of multiple processes to operate in parallel and use the same shared data without causing corruption to the shared data. For example, during a commit phase, a corresponding transaction can attempt to increment a globally accessible version information variable and store a current value of the globally accessible version information variable for updating version information associated with modified data regardless of whether an associated attempt by the corresponding transaction to modify the globally accessible version information variable was successful. As an alternative mode, a corresponding transaction can merely read and store a current value of the globally accessible version information variable without attempting to update the globally accessible version information variable before such use. In yet another application, a parallel processing environment implements a combination of both aforementioned modes depending on a self-abort rate of the transaction.

    摘要翻译: 本公开描述了多个进程中的每一个并行操作并使用相同的共享数据而不会对共享数据造成损坏的唯一方式。 例如,在提交阶段期间,相应的事务可以尝试增加全局可访问的版本信息变量并存储全局可访问版本信息变量的当前值,用于更新与经修改的数据相关联的版本信息,而不管相关联的尝试是否相应 修改全局可访问版本信息变量的事务成功。 作为替代模式,相应的事务只能读取和存储全局可访问版本信息变量的当前值,而不尝试在此类使用之前更新全局可访问版本信息变量。 在另一个应用中,并行处理环境根据交易的自我中止率实现两种上述模式的组合。

    Scalable method for producer and consumer elimination
    9.
    发明申请
    Scalable method for producer and consumer elimination 有权
    消除生产者和消费者的可扩展方法

    公开(公告)号:US20060123156A1

    公开(公告)日:2006-06-08

    申请号:US11325150

    申请日:2006-01-04

    IPC分类号: G06F13/28

    摘要: Producers and consumer processes may synchronize and transfer data using a shared data structure. After locating a potential transfer location that indicates an EMPTY status, a producer may store data to be transferred in the transfer location. A producer may use a compare-and-swap (CAS) operation to store the transfer data to the transfer location. A consumer may subsequently read the transfer data from the transfer location and store, such as by using a CAS operation, a DONE status indicator in the transfer location. The producer may notice the DONE indication and may then set the status location back to EMPTY to indicate that the location is available for future transfers, by the same or a different producer. The producer may also monitor the transfer location and time out if no consumer has picked up the transfer data.

    摘要翻译: 生产者和消费者流程可以使用共享数据结构来同步和传输数据。 在找到指示EMPTY状态的潜在转移位置之后,生产者可以将要传送的数据存储在传送位置。 生产者可以使用比较和交换(CAS)操作来将转移数据存储到传送位置。 消费者随后可以从传送位置读取传送数据,例如通过使用CAS操作存储传送位置中的DONE状态指示符。 生产者可以注意到DONE指示,然后可以将状态位置设置回EMPTY,以指示该位置可用于由相同或不同的生产者进行将来的转移。 如果没有消费者拿起传输数据,生产者也可以监控传送位置和超时。

    Recovering data in a logical object utilizing an inferred recovery list
    10.
    发明授权
    Recovering data in a logical object utilizing an inferred recovery list 有权
    使用推断的恢复列表恢复逻辑对象中的数据

    公开(公告)号:US09250821B2

    公开(公告)日:2016-02-02

    申请号:US13209295

    申请日:2011-08-12

    IPC分类号: G06F12/00 G06F13/00 G06F3/06

    摘要: Various embodiments for storing a logical object are provided. In one such embodiment, by way of example only, incoming data is divided corresponding to a logical data object into a plurality of independent streams, associating each data chunk of a plurality of obtained data chunks with a corresponding stream among the plurality of independent streams. At least one of the obtained data chunks and derivatives thereof is sequentially accommodated in accordance with an order the obtained chunks are received, while keeping the association with the corresponding streams. A global index is generated as a single meta-data stream accommodated in the logical data object and comprising information common to the plurality of independent streams and related to mapping between data in the logical data object and the obtained data chunks.

    摘要翻译: 提供了用于存储逻辑对象的各种实施例。 在一个这样的实施例中,仅作为示例,将对应于逻辑数据对象的输入数据划分成多个独立流,将多个获得的数据块中的每个数据块与多个独立流中的对应流相关联。 所获得的数据块及其派生中的至少一个按照所获取的块被接收的顺序顺序地被容纳,同时保持与相应流的关联。 全局索引被生成为容纳在逻辑数据对象中的单个元数据流,并且包括与多个独立流共同的信息,并且涉及逻辑数据对象中的数据与获得的数据块之间的映射。