Metrics aggregation
    81.
    发明授权

    公开(公告)号:US11829632B2

    公开(公告)日:2023-11-28

    申请号:US17454247

    申请日:2021-11-09

    申请人: VAST DATA LTD.

    IPC分类号: G06F3/06

    摘要: A method for monitoring a storage system, the method may include (a) generating a compute entity (CE) storage metric by each CE of a group of CEs to provide multiple CE storage metrics, wherein the multiple CE metrics are related to a monitoring period; and (b) calculating, during a calculation period, a group metric based on the multiple CE storage metrices; wherein the calculating includes performing multiple calculations iterations, wherein each calculation iteration includes (a) selecting an updating CE that belongs to the group of CEs and was not previously selected during the calculation period, (b) accessing, by the updating CE, a shared data structure that stores the group storage metric, and (c) updating the group storage metric using the CE storage metric of the updating CE.

    Managing a read statement of a transaction

    公开(公告)号:US11829354B2

    公开(公告)日:2023-11-28

    申请号:US17646294

    申请日:2021-12-28

    申请人: VAST DATA LTD.

    发明人: Eyal Gordon Asaf Levy

    IPC分类号: G06F16/00 G06F16/23

    CPC分类号: G06F16/2379

    摘要: A method for managing a read statement of a transaction, the method may include: (a) receiving the read statement, wherein the read statement is for receiving a data unit that is stored in a relational database; (b) finding one or more candidate versions of the data unit; wherein the finding may include: (i) accessing a database segment (DS) version metadata of one or more DS versions of one or more DSs that are related to the data unit and are stored in the relational database; (ii) performing a timestamp based determination that may include checking whether to ignore a database segment version when the database segment version metadata identifies the database segment version by a database segment commit timestamp; and (iii) performing a transaction metadata based determination of whether to ignore the database segment version when the database segment version metadata identifies the database segment version by a transaction identifier; and (c) responding to the read statement by outputting a version of the one or more candidate versions of the data unit.

    DATA AWARE COMPRESSION IN A STORAGE SYSTEM
    83.
    发明公开

    公开(公告)号:US20230353167A1

    公开(公告)日:2023-11-02

    申请号:US17661264

    申请日:2022-04-28

    申请人: VAST DATA LTD.

    IPC分类号: H03M7/30

    摘要: A method for storage system data aware compression, the method may include pre-compressing data units received by the storage system, by different pre-compression units to provide different pre-compressed versions of the data units; wherein the different pre-compression schemes are associated with different compression schemes, wherein at least some of the different compression schemes are data type specific compression schemes; calculating entropies of the different pre-compressed versions; and selecting a compression scheme out of the different compression schemes based on the entropies of the different pre-compressed versions.

    MONITORING LARGEST FILE SYSTEM ENTITIES
    84.
    发明公开

    公开(公告)号:US20230350856A1

    公开(公告)日:2023-11-02

    申请号:US17661036

    申请日:2022-04-27

    申请人: VAST DATA LTD.

    摘要: A method for monitoring largest file system entities of a file system that is stored in a storage system, the method may include populating, during multiple population iterations, a cache of the storage system with largest file system entities metadata; wherein a current population iteration of the multiple population iterations may include pushing, to a heap, metadata related to a set of one or more file system entities that are children of a parent file system entity that was deemed a largest file system entity of a last population iteration that preceded the current population iteration; popping the heap to provide a current largest file system entity; and storing metadata related to the current largest file system entity in the cache.

    CONTENTION-REDUCED UPDATE OF STORAGE SYSTEM PARAMETERS

    公开(公告)号:US20230333734A1

    公开(公告)日:2023-10-19

    申请号:US17659321

    申请日:2022-04-14

    申请人: VAST DATA LTD.

    发明人: Amir Miron Avi Goren

    IPC分类号: G06F3/06 G06F9/30

    摘要: A method for contention reduced update of one or more storage system parameters, the method may include (i) concurrently monitoring the one or more storage system parameters (SSPs) by compute entities (CEs); wherein the concurrently monitoring comprises updating, by the CEs, local counters allocated to different SSPs; (ii) updating, by the CEs, sets of shared counter fields with values of the local counters, wherein different sets are allocated to different SSPs; wherein an updating of a set of a shared counter fields by an CE comprises selecting a shared counter field of the set by the CE; and (iii) calculating values of the different SSPs, wherein a calculating of a value of a SSP is based on at least one value of at least one shared counter field of a set that is allocated to the SSP.

    Lock metadata re-balancing upon storage expansion

    公开(公告)号:US11789924B2

    公开(公告)日:2023-10-17

    申请号:US17450991

    申请日:2021-10-14

    申请人: VAST DATA LTD.

    IPC分类号: G06F16/00 G06F16/23

    CPC分类号: G06F16/2343

    摘要: A method for lock metadata re-balancing upon an expansion of a storage system, the method may include instructing multiple compute entities, by an expansion manager and during a first phase of the lock metadata re-balancing, to acquire locks by using: (a) a current translation function for linking addresses of current lock metadata units (LMUs) to identifiers of stored entities; wherein the current translation function is based on a size of a current storage space allocated to the lock metadata; and (b) a next translation function for linking addresses of new LMUs to identifiers of stored entities; wherein the new translation function is based on a size of a new storage space allocated to the lock metadata; wherein the current space is expanded during the expansion of the storage system to provide the next storage space. Instructing the multiple compute entities, by the expansion manager, and during another phase of the lock metadata re-balancing that follows a release of all current LMUs, to acquire locks and check status of locks using the next translation function without using the current translation function.

    Snapshot capacity estimation
    87.
    发明授权

    公开(公告)号:US11789900B1

    公开(公告)日:2023-10-17

    申请号:US17657339

    申请日:2022-03-30

    申请人: VAST DATA LTD.

    CPC分类号: G06F16/128 G06F16/1748

    摘要: A method for determining size information related one or more snapshots related to file systems stored in a storage system, the method may include (a) sampling one or more combinations of points in time and logical spaces, the logical spaces are associated with the one or more file systems to provide sampled combinations of sampled portions of file system entities (FSEs) and sampled points in time; (b) searching for relevant snapshots that are relevant to the sampled combinations to provide relevant snapshots at the sampled points in time; and (c) determining physical sizes of the relevant snapshots at the sampled point in time; wherein a number of samples per sampled FSE is indicative of a size of the sampled FSEs.

    FILE SYSTEMS CAPACITY ESTIMATION
    88.
    发明公开

    公开(公告)号:US20230315606A1

    公开(公告)日:2023-10-05

    申请号:US17657343

    申请日:2022-03-30

    申请人: VAST DATA LTD.

    摘要: A method for determining size information related one or more file systems stored in a storage system, the method may include (i) sampling one or more logical spaces that are associated with the one or more file systems to provide sampled file system entities (FSEs); wherein a number of samples per sampled FSE is indicative of a size of the sampled FSEs; and (ii) determining logical sizes and physical sizes of different levels of the one or more file systems based on the sampled file system entities.

    Data recovery in a storage system
    89.
    发明授权

    公开(公告)号:US11734117B2

    公开(公告)日:2023-08-22

    申请号:US17302318

    申请日:2021-04-29

    申请人: VAST DATA LTD.

    IPC分类号: G06F11/00 G06F11/14 G06F11/10

    摘要: A method for recovering failed chunks, the method may include (i) obtaining a failure indication about a failure of a first number (X1) of failed chunks; wherein the chunks were stored in a group of disks, the group of disks is configured to store a second number (α) stripes of multiple (N) chunks, wherein each stripe comprises a first plurality (K) of data chunks and a second plurality (R) of parity chunks; wherein R exceeds





    (


    X

    1

    α

    )

    ;




    and (ii) performing at least one recovery iteration until fulfilling a stop condition. Each recovery iteration of the at least one recovery iteration may include (a.i) selecting valid chunks to provide selected valid chunks, wherein a number of selected chunks is smaller than a product of a multiplication of R by α; (a.ii) retrieving valid data chunks that are relevant to the selected valid chunks; and (a.iii) attempting to reconstruct the failed chunks based on the retrieved chunks.