DATA RECOVERY IN A STORAGE SYSTEM

    公开(公告)号:US20220358017A1

    公开(公告)日:2022-11-10

    申请号:US17302318

    申请日:2021-04-29

    申请人: VAST DATA LTD.

    IPC分类号: G06F11/14 G06F11/10

    摘要: A method for recovering failed chunks, the method may include (i) obtaining a failure indication about a failure of a first number (X1) of failed chunks; wherein the chunks were stored in a group of disks, the group of disks is configured to store a second number (α) stripes of multiple (N) chunks, wherein each stripe comprises a first plurality (K) of data chunks and a second plurality (R) of parity chunks; wherein R exceeds ( X ⁢ 1 α ) ; and (ii) performing at least one recovery iteration until fulfilling a stop condition. Each recovery iteration of the at least one recovery iteration may include (a.i) selecting valid chunks to provide selected valid chunks, wherein a number of selected chunks is smaller than a product of a multiplication of R by α; (a.ii) retrieving valid data chunks that are relevant to the selected valid chunks; and (a.iii) attempting to reconstruct the failed chunks based on the retrieved chunks.

    System and method for time synchronization using snap values

    公开(公告)号:US11341160B2

    公开(公告)日:2022-05-24

    申请号:US16592286

    申请日:2019-10-03

    申请人: Vast Data Ltd.

    IPC分类号: G06F16/27

    摘要: A system and method for time synchronization. The method includes incrementing at least one instance of a snap value, wherein the at least one instance is stored in at least one storage node of a distributed storage system, wherein each of the at least one instance is incremented using a single-phase commit operation, wherein each of the plurality of storage nodes includes at least one timestamp, wherein each timestamp indicates a corresponding snap time, wherein each snap time is determined by reading one of the at least one instance at a time of creation of the corresponding timestamp.

    Global access to filesystem content

    公开(公告)号:US12105671B1

    公开(公告)日:2024-10-01

    申请号:US18306969

    申请日:2023-04-25

    申请人: VAST DATA LTD.

    摘要: A method for managing access to a shared file system entity (FSE), the method includes (i) managing access requests for reading and writing accessed parts of the FSE, by a current point of access storage system (POASS), the current POASS currently acts as a point of access (POA) for the access requests; wherein stored parts of the FSE are stored at multiple POASSs, the multiple POASSs comprise the current POASS and former POASSs; (ii) determining, by the current POASS and while managing the access requests, to store the stored parts of the FSE at a fewer number of the former POASSs; and (iii) reducing, by two or more of the former POASSs, the number of former POASSs that store the stored parts of the FSE.

    Data aware compression in a storage system

    公开(公告)号:US11936404B2

    公开(公告)日:2024-03-19

    申请号:US17661264

    申请日:2022-04-28

    申请人: VAST DATA LTD.

    IPC分类号: H03M7/30

    摘要: A method for storage system data aware compression, the method may include pre-compressing data units received by the storage system, by different pre-compression units to provide different pre-compressed versions of the data units; wherein the different pre-compression schemes are associated with different compression schemes, wherein at least some of the different compression schemes are data type specific compression schemes; calculating entropies of the different pre-compressed versions; and selecting a compression scheme out of the different compression schemes based on the entropies of the different pre-compressed versions.

    System and method for using free space to improve erasure code locality

    公开(公告)号:US11886705B2

    公开(公告)日:2024-01-30

    申请号:US17503861

    申请日:2021-10-18

    申请人: Vast Data LTD.

    发明人: Yogev Vaknin

    IPC分类号: G06F3/06

    摘要: A system and method for using free space for recovering erasure coding data sets. The method includes segmenting at least one erasure coding data set into at least one stripe based on an erasure coding scheme, wherein each erasure coding data set includes chunks, wherein the chunks include chunks of systematic data and chunks of parity data; distributing the at least one stripe across non-volatile memory nodes based on the erasure coding scheme, wherein each non-volatile memory node is a unit of a non-volatile storage device; and upon a first failure of one of the non-volatile memory nodes: detecting that at least one of the non-volatile memory nodes that is not failed includes a first free space that does not currently store user data; and performing a first recovery process for recovering a first portion of the at least one erasure coding data set, based on the first free space.

    Striping in a storage system
    6.
    发明授权

    公开(公告)号:US11842074B2

    公开(公告)日:2023-12-12

    申请号:US17207721

    申请日:2021-03-21

    申请人: Vast Data Ltd.

    IPC分类号: G06F3/06

    摘要: A method for striping, the method may include performing, for each period of time out of multiple periods of time, the steps of: (i) determining striping rules; wherein the determining of the striping rules may include selecting one or more selected stripe size values out of multiple stripe size value candidates; wherein the selecting is based on values of storage system parameters that are obtained when applying the multiple stripe size value candidates; wherein the storage system parameters comprise storage space utilization and storage system throughput; and (ii) applying the striping rules by the storage system, during the period of time; wherein the applying comprises obtaining data chunks; converting the data chunks to stripes having at least one of the one or more selected stripe size values; and storing the stripes in the storage system.

    Untying compression related links to stale reference chunks

    公开(公告)号:US11829622B2

    公开(公告)日:2023-11-28

    申请号:US17650245

    申请日:2022-02-07

    申请人: VAST DATA LTD.

    IPC分类号: G06F3/06

    摘要: A method for selectively untying at least one of compression related links to a stale reference chunk, the method may include determining whether a compression effectiveness condition is fulfilled in relation to a set of referring chunks that are compressed using the stale reference chunk and are linked to the to the stale reference chunk by the compression related links; wherein the compression effectiveness condition is responsive to, at least, a number of the referring chunks of the set; and untying the at least one compression related links to the stale reference chunks when the compression effectiveness condition is not fulfilled.

    Techniques for improved erasure coding in distributed storage systems

    公开(公告)号:US11239864B2

    公开(公告)日:2022-02-01

    申请号:US16502690

    申请日:2019-07-03

    申请人: Vast Data Ltd.

    摘要: A system and method for erasure coding. The method includes distributing a plurality of data chunks according to a mirroring scheme, wherein the plurality of data chunks is distributed as a plurality of rows among a plurality of non-volatile memory (NVM) nodes, wherein the mirroring scheme defines a plurality of groups, each group including a subset of the plurality of data chunks, wherein each data chunk in a group has a role corresponding to a relative position of the data chunk within the group, wherein data chunks included in the plurality of groups having the same relative positions within their respective groups have the same role, wherein each row of the plurality of rows includes at least one summation data chunk that is a function of at least one data chunk included in the row and of at least one extra data chunk included in at least one other row.

    UNTYING COMPRESSION RELATED LINKS TO STALE REFERENCE CHUNKS

    公开(公告)号:US20230251787A1

    公开(公告)日:2023-08-10

    申请号:US17650245

    申请日:2022-02-07

    申请人: VAST DATA LTD.

    IPC分类号: G06F3/06

    摘要: A method for selectively untying at least one of compression related links to a stale reference chunk, the method may include determining whether a compression effectiveness condition is fulfilled in relation to a set of referring chunks that are compressed using the stale reference chunk and are linked to the to the stale reference chunk by the compression related links; wherein the compression effectiveness condition is responsive to, at least, a number of the referring chunks of the set; and untying the at least one compression related links to the stale reference chunks when the compression effectiveness condition is not fulfilled.

    Power consumption control
    10.
    发明授权

    公开(公告)号:US11687146B1

    公开(公告)日:2023-06-27

    申请号:US17652929

    申请日:2022-02-28

    申请人: VAST DATA LTD.

    CPC分类号: G06F1/3287 G06F1/3206

    摘要: A method for power management of a storage system unit, the method may include selecting a power reduction measure out of (a) a shutdown of at least one stateless compute node out of stateless compute nodes of the storage system unit, and (b) an other power reduction measure that does not involve the shutdown of the at least one stateless compute node, while prioritizing the shutdown of the at least one stateless compute node over the other power reduction measure; wherein the storage system unit further comprises storage nodes; wherein states related to communications with client computers (i) are maintained in the storage nodes, and (ii) are not stored on the stateless compute nodes; and applying the power reduction measure based on the selecting.