Persistent key-value store and journaling system

    公开(公告)号:US11940911B2

    公开(公告)日:2024-03-26

    申请号:US17553930

    申请日:2021-12-17

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for implementing a persistent key-value store for caching client data, journaling, and/or crash recovery. The persistent key-value store may be hosted as a primary cache that provides read and write access to key-value record pairs stored within the persistent key-value store. The key-value record pairs are stored within multiple chains in the persistent key-value store. Journaling is provided for the persistent key-value store such that incoming key-value record pairs are stored within active chains, and data within frozen chains is written in a distributed manner across distributed storage of a distributed cluster of nodes. If there is a failure within the distributed cluster of nodes, then the persistent key-value store may be reconstructed and used for crash recovery.

    Co-located Journaling and Data Storage for Write Requests

    公开(公告)号:US20240061603A1

    公开(公告)日:2024-02-22

    申请号:US18497925

    申请日:2023-10-30

    Applicant: NetApp, Inc.

    Abstract: Methods and systems for co-locating journaling and data storage are provided. Separate journal and volume partitions may be maintained within each logical storage unit (e.g., Logical Unit Number (LUN)) of a distributed storage system. Journaling of metadata associated with write requests received from one or more clients may be distributed by identifying a destination logical storage unit to which data associated with a given write request is to be stored and causing the data and metadata to be persisted to disk by journaling the metadata and the data to respective portions of an active log within the journal partition of the destination logical storage unit. By using the same logical storage unit for both journaling of write requests and writing the data associated with such write requests, the bottleneck due to there being only a single device or storage unit handling all metadata for all write requests can be avoided.

    BYTE-ADDRESSABLE JOURNAL HOSTED USING BLOCK STORAGE DEVICE

    公开(公告)号:US20230315695A1

    公开(公告)日:2023-10-05

    申请号:US17710638

    申请日:2022-03-31

    Applicant: NetApp Inc.

    CPC classification number: G06F16/1815 G06F16/1824 G06F16/172 G06F16/178

    Abstract: Techniques are provided for implementing a journal using a block storage device for a plurality of clients. A journal may be hosted as a primary cache for a node, where I/O operations of a plurality of clients are logged within the journal. The node may be part of a distributed cluster of nodes hosted within a container orchestration platform. The journal may be stored in a storage device comprising a block storage device and a cache. Adaptive caching may be implemented to store some journal data of the journal in the cache. For example, a first set of journal data may be stored in the block storage device without storing the first set of journal data in the cache. A second set of journal data may be stored in the block storage device and the cache.

    Recovery mechanism with selective ordering and concurrent operations

    公开(公告)号:US12086035B2

    公开(公告)日:2024-09-10

    申请号:US17886843

    申请日:2022-08-12

    Applicant: NetApp Inc.

    CPC classification number: G06F11/1469 G06F11/1464 G06F11/1471

    Abstract: Techniques are provided for a recovery process with selective ordering and concurrent operations in order to recover from a failure. Representations of active log structures are rebuilt within memory according to ordering values assigned to I/O operations logged within the active log structures. Representation of certain active log structures may be concurrently rebuilt based upon the active log structures comprising I/O operations that are non-overlapping within a distributed file system, have no dependencies, relate to different services, and/or target independent files. Representation of stale log structures are concurrently rebuilt within memory. While rebuilding the log structures and executing the I/O operations, a key value map is concurrently rebuilt within the memory for locating data of the I/O operations. Concurrent operations during the recovery process reduces the time to complete the recovery process, and thus reduces client downtime during the recovery process.

    CO-LOCATED JOURNALING AND DATA STORAGE FOR WRITE REQUESTS

    公开(公告)号:US20220357868A1

    公开(公告)日:2022-11-10

    申请号:US17868260

    申请日:2022-07-19

    Applicant: NetApp, Inc.

    Abstract: A method and system for co-locating journaling and data storage based on write requests. A write request that includes metadata and data is received from a client. A logical storage unit for storing the metadata and the data is identified. The logical storage unit is divided into a journal partition and a volume partition. The journal partition includes a first log and a second log. Which of the first log and the second log is an active log and which of the first log and the second log is an inactive log are identified. The metadata is recorded in a first location in the active log and the data is recorded in a second location in the active log during a single I/O operation. A reply is sent to the client after the metadata and the data are recorded in the journal partition.

    NETWORK STORAGE FAILOVER SYSTEMS AND ASSOCIATED METHODS

    公开(公告)号:US20210334179A1

    公开(公告)日:2021-10-28

    申请号:US16855837

    申请日:2020-04-22

    Applicant: NETAPP, INC.

    Abstract: Failover methods and systems for a networked storage environment are provided. A filtering data structure and a metadata data structure are generated before starting a replay of a log stored in a non-volatile memory of a second storage node, during a failover operation initiated in response to a failure at a first storage node. The second storage node operates as a partner node of the first storage node to mirror at the log one or more write requests received by the first storage node prior to the failure, and data associated with the one or more write requests. The filtering data structure identifies each log entry and the metadata structure stores a metadata attribute of each log entry. The filtering data structure and the metadata structure are used for providing access to a logical storage object during the log replay from the second storage node.

    Deferred Replication of Recovery Information At Site Switchover
    10.
    发明申请
    Deferred Replication of Recovery Information At Site Switchover 有权
    在站点切换时延迟复制恢复信息

    公开(公告)号:US20150331766A1

    公开(公告)日:2015-11-19

    申请号:US14276375

    申请日:2014-05-13

    Applicant: NetApp, Inc.

    Abstract: Methods, systems, and computer program products for providing deferred replication of recovery information at site switchover are disclosed. A computer-implemented method may include receiving a first copy of logged data for storage volumes of a disaster recovery (DR) partner at a remote site from the DR partner, receiving a request to perform a site switchover from the remote site to the local site, receiving a second copy of logged data for the storage volumes from a local high availability (HA) partner in response to the switchover, and recovering the storage volumes locally by applying one or more of the copies of logged data to corresponding mirrored storage volumes at the local site.

    Abstract translation: 公开了用于在现场切换时提供恢复信息的延迟复制的方法,系统和计算机程序产品。 计算机实现的方法可以包括接收来自DR合作伙伴的远程站点处的灾难恢复(DR)伙伴的存储卷的记录数据的第一副本,接收执行从远程站点到本地站点的站点切换的请求 响应切换从本地高可用性(HA)合作伙伴接收用于存储卷的记录数据的第二副本,以及通过将一个或多个记录数据副本应用于相应的镜像存储卷来本地地恢复存储卷 当地网站。

Patent Agency Ranking