Amortized snapshots
    1.
    发明授权
    Amortized snapshots 有权
    摊销快照

    公开(公告)号:US09547560B1

    公开(公告)日:2017-01-17

    申请号:US14752711

    申请日:2015-06-26

    发明人: Kerry Quintin Lee

    IPC分类号: G06F11/14

    摘要: A system and method for generating and storing at least one snapshot update. The system and method comprising determining a first set of blocks including blocks that have changed since a time of a previous snapshot, determining a second set of blocks based at least in part on a predetermined amount, generating at least one snapshot update of a volume based at least in part on a combination of the first set of blocks and the second set of blocks, and storing the at least one snapshot update.

    摘要翻译: 一种用于生成和存储至少一个快照更新的系统和方法。 该系统和方法包括确定包括从先前快照的时间起已经改变的块的第一组块,至少部分地基于预定量来确定第二组块,生成基于卷的至少一个快照更新 至少部分地基于所述第一组块和所述第二组块的组合,并且存储所述至少一个快照更新。

    Data storage area cleaner
    2.
    发明授权

    公开(公告)号:US10331375B1

    公开(公告)日:2019-06-25

    申请号:US13924125

    申请日:2013-06-21

    摘要: A block-level data storage system receives a request to delete a data storage volume. As a result, the data storage volume is deleted and the areas comprising the volume are released and reaped. The areas may contain non-zero data within a plurality of data storage chunks that comprise the areas. An area cleaner is configured to zero out the areas for allocation to a newly created data storage volume.

    System and method for performing object-modifying commands in an unstructured storage service

    公开(公告)号:US09760576B1

    公开(公告)日:2017-09-12

    申请号:US14216216

    申请日:2014-03-17

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30129 G06F17/30979

    摘要: Embodiments of system and method for performing object-modifying commands in an unstructured storage service are described. Embodiments may include utilizing one or more nodes to implement an unstructured storage service including a service interface configured to service data storage requests and data retrieval requests from remote clients. The unstructured storage service is configured to isolate access to each of multiple storage domains of the service to different clients. Embodiments may also include receiving from a given remote client, a request to store a data object to a given storage domain of the service. The request further specifying a command to modify source data for the object prior to storing the object. Embodiments may also include using the unstructured storage service to perform the command without exporting the source data from the unstructured storage service to the given remote client prior to completion of the command.

    Dead letter queue for smart fleet management

    公开(公告)号:US09753802B1

    公开(公告)日:2017-09-05

    申请号:US14673845

    申请日:2015-03-30

    摘要: A system and method for using a dead letter queue to regulate host computing systems performing transformation or migration operations. The system and method including reading a message from a queue, the message including one or more references to a set of data objects, with the set of data objects including one or more data objects selected for a transformation operation according to a transformation scheme. The system and method further including performing a mitigation action upon determination that the message is one of a number of unsuccessfully processed messages in the queue that are associated with the computer system, when the number of unsuccessfully processed messages exceed a threshold.

    Optimized write performance at block-based storage during volume snapshot operations
    5.
    发明授权
    Optimized write performance at block-based storage during volume snapshot operations 有权
    在卷快照操作期间优化基于块的存储的写入性能

    公开(公告)号:US09405483B1

    公开(公告)日:2016-08-02

    申请号:US14205046

    申请日:2014-03-11

    IPC分类号: G06F3/06

    摘要: Write optimization for block-based storage performing snapshot operations may be implemented. Write requests for a particular data volume may be received for which a snapshot operation is in progress. A determination may be made as to whether a data chunk of the data volume modified as part of the write request has not yet been stored to a remote snapshot data store as part of the snapshot operation. For a data chunk that is to be modified and that has not yet been stored, the data chunk may be stored in a local in-memory volume snapshot buffer. Once the data chunk is stored in the in-memory volume snapshot buffer, the write request may be performed and acknowledged as complete. The data chunk may be sent to the remote snapshot data store asynchronously with regard to the acknowledgment of the write request.

    摘要翻译: 可以实现对执行快照操作的基于块的存储的写入优化。 可能会收到针对特定数据卷的写请求正在进行快照操作。 作为快照操作的一部分,可以确定作为写请求的一部分修改的数据卷的数据块是否还没有被存储到远程快照数据存储。 对于要修改并且尚未存储的数据块,数据块可以存储在本地内存卷快照缓冲区中。 一旦数据块被存储在内存卷快照缓冲器中,写请求可以被执行并被确认为完成。 关于写请求的确认,数据块可以异步地发送到远程快照数据存储。

    System and method for performing object-modifying commands in an unstructured storage service

    公开(公告)号:US11494437B1

    公开(公告)日:2022-11-08

    申请号:US15701338

    申请日:2017-09-11

    摘要: Embodiments of system and method for performing object-modifying commands in an unstructured storage service are described. Embodiments may include utilizing one or more nodes to implement an unstructured storage service including a service interface configured to service data storage requests and data retrieval requests from remote clients. The unstructured storage service is configured to isolate access to each of multiple storage domains of the service to different clients. Embodiments may also include receiving from a given remote client, a request to store a data object to a given storage domain of the service. The request further specifying a command to modify source data for the object prior to storing the object. Embodiments may also include using the unstructured storage service to perform the command without exporting the source data from the unstructured storage service to the given remote client prior to completion of the command.

    Ensuring data integrity during large-scale data migration

    公开(公告)号:US11030063B1

    公开(公告)日:2021-06-08

    申请号:US14673839

    申请日:2015-03-30

    摘要: A system and method for maintaining data integrity during data transformation operations. The system and method include obtaining a message from a set of queues, obtaining, from a first data store, a data object indicated by the message, and generating, at a first host, a set of error detection codes corresponding to a transformation of the data object according to a transformation scheme. The system and method further include, transforming, at a second host different from the first host, the data object according to the transformation scheme into the transformation of the data object, verifying the transformation against the set of error detection codes, and storing the transformation in a second data store.

    Cursor remirroring
    10.
    发明授权
    Cursor remirroring 有权
    光标重新镜像

    公开(公告)号:US09436407B1

    公开(公告)日:2016-09-06

    申请号:US13860343

    申请日:2013-04-10

    IPC分类号: G06F3/06

    摘要: Methods and systems for cursor remirroring are disclosed. A mirroring process is initiated for a plurality of chunks stored by a master node. The mirroring process comprises visiting a sequence of one or more of the chunks and, for at least some of the chunks, copying chunk data or metadata to a slave node. During the initiated mirroring process, a request is received for a write operation on one of the chunks stored by the master node. If the chunk in the request has been visited in the mirroring process, the write operation is performed on the master node and on the slave node. If the chunk in the request has not been visited, the write operation is performed on the master node and postponed on the slave node until the chunk in the request has been visited in the mirroring process.

    摘要翻译: 公开了用于光标重新镜像的方法和系统。 为由主节点存储的多个块启动镜像处理。 镜像过程包括访问一个或多个块的序列,并且对于至少一些块,将块数据或元数据复制到从节点。 在启动的镜像处理期间,接收到由主节点存储的块之一上的写入操作的请求。 如果在镜像过程中访问了请求中的块,则在主节点和从节点上执行写操作。 如果请求中的块没有被访问,则在主节点上执行写入操作,并在从节点上延迟,直到在镜像过程中访问了请求中的块。