Scalable storage space allocation in distributed storage systems

    公开(公告)号:US10223035B2

    公开(公告)日:2019-03-05

    申请号:US14839853

    申请日:2015-08-28

    Applicant: VMware, Inc.

    Abstract: System and method for managing storage metadata utilize a metadata data structure containing allocation information of storage blocks of a storage system in which a portion of the metadata data structure that corresponds to a group of the storage blocks can be reserved to a requesting client, which then manages the portion of the metadata data structure using a copy of the portion of the metadata data structure.

    Multi-tenant production and test deployments of Hadoop

    公开(公告)号:US10216758B2

    公开(公告)日:2019-02-26

    申请号:US14062723

    申请日:2013-10-24

    Applicant: VMware, Inc.

    Abstract: A distributed computing application is described that provides a highly elastic and multi-tenant platform for Hadoop applications and other workloads running in a virtualized environment. Production, test, and development deployments of a Hadoop application may be executed using multiple compute clusters and a shared instance of a distributed filesystem, or in other cases, multiple instances of the distributed filesystem. Data nodes executing as virtual machines (VMs) for test and development deployments can be linked clones of data nodes executing as VMs for a production deployment to reduce duplicated data and provide a shared storage space.

    Virtual file system with vnode reconstruction capability

    公开(公告)号:US10168947B2

    公开(公告)日:2019-01-01

    申请号:US14706879

    申请日:2015-05-07

    Applicant: VMware, Inc.

    Abstract: A virtual file system and method for performing virtual file system operations uses a vnode descriptor to access a vnode for a vnode operation. If the vnode is not found in a vnode cache using the vnode descriptor, the vnode is reconstructed using information regarding the vnode found outside of the vnode cache using the vnode descriptor.

    Multi-level access control for distributed storage systems

    公开(公告)号:US10095875B2

    公开(公告)日:2018-10-09

    申请号:US14839815

    申请日:2015-08-28

    Applicant: VMware, Inc.

    Abstract: System and method for accessing a distributed storage system uses a storage-level access control process at a distributed file system that interfaces with the distributed storage system to determine whether a particular client has access to a particular first file system object using an identifier of the particular client and storage-level access control rules in response to a file system request from the particular client to access a second file system object in the particular first file system. The storage-level access control rules are defined for a plurality of clients and a plurality of first file system objects of the distributed storage system to allow the particular client access to the second file system object in the particular first file system object only if the particular client has been determined to have access to the particular first file system object according to the storage-level access control rules.

    Fast file clone using copy-on-write B-tree

    公开(公告)号:US10025806B2

    公开(公告)日:2018-07-17

    申请号:US14837166

    申请日:2015-08-27

    Applicant: VMware, Inc.

    Abstract: A file system uses a B-tree data structure to organize file data. The file system may maintain an index node (mode) representing a file and having entries that map to extents of the file. When the file system detects an index node, through updates, has exceeded a threshold number of extents, the file system converts the file to a copy-on-write (COW) B-tree data structure containing the entries representing the extents of the file. To clone the file, the file system uses copies of the index node and the root node of the COW B-tree data structure.

    SCALABLE STORAGE SPACE ALLOCATION IN DISTRIBUTED STORAGE SYSTEMS
    7.
    发明申请
    SCALABLE STORAGE SPACE ALLOCATION IN DISTRIBUTED STORAGE SYSTEMS 审中-公开
    分布式存储系统中可扩展的存储空间分配

    公开(公告)号:US20170060432A1

    公开(公告)日:2017-03-02

    申请号:US14839853

    申请日:2015-08-28

    Applicant: VMware, Inc.

    Abstract: System and method for managing storage metadata utilize a metadata data structure containing allocation information of storage blocks of a storage system in which a portion of the metadata data structure that corresponds to a group of the storage blocks can be reserved to a requesting client, which then manages the portion of the metadata data structure using a copy of the portion of the metadata data structure.

    Abstract translation: 用于管理存储元数据的系统和方法利用包含存储系统的存储块的分配信息的元数据数据结构,其中对应于一组存储块的元数据数据结构的一部分可以保留给请求客户端 使用元数据数据结构的一部分的副本来管理元数据数据结构的一部分。

    Virtualization-aware data locality in distributed data processing
    8.
    发明授权
    Virtualization-aware data locality in distributed data processing 有权
    分布式数据处理中的虚拟化感知数据局部性

    公开(公告)号:US09582221B2

    公开(公告)日:2017-02-28

    申请号:US13907393

    申请日:2013-05-31

    Applicant: VMware, Inc.

    Abstract: A virtualized computing system for executing a distributed computing application, such as Hadoop, is discussed. The virtualized computing system stores data in a distributed filesystem, such as Hadoop Distributed File System, and processes data using a topology awareness that takes into account the virtualization layer of the virtualized computing system. The virtualized computing system employs locality-related policies, including replica placement policies, replica choosing policies, balancer policies, and task scheduling policies that take advantage of the awareness of the virtualization topology.

    Abstract translation: 讨论了用于执行诸如Hadoop的分布式计算应用的虚拟化计算系统。 虚拟化计算系统将数据存储在诸如Hadoop分布式文件系统之类的分布式文件系统中,并使用考虑到虚拟化计算系统的虚拟化层的拓扑感知来处理数据。 虚拟化计算系统采用与地理相关的策略,包括复制放置策略,副本选择策略,平衡器策略以及利用虚拟化拓扑的意识的任务调度策略。

    Multi-level access control for distributed storage systems

    公开(公告)号:US10678932B2

    公开(公告)日:2020-06-09

    申请号:US16153633

    申请日:2018-10-05

    Applicant: VMware, Inc.

    Abstract: System and method for accessing a distributed storage system uses a storage-level access control process at a distributed file system that interfaces with the distributed storage system to determine whether a particular client has access to a particular first file system object using an identifier of the particular client and storage-level access control rules in response to a file system request from the particular client to access a second file system object in the particular first file system. The storage-level access control rules are defined for a plurality of clients and a plurality of first file system objects of the distributed storage system to allow the particular client access to the second file system object in the particular first file system object only if the particular client has been determined to have access to the particular first file system object according to the storage-level access control rules.

    Distributed file system consistency check

    公开(公告)号:US10417193B2

    公开(公告)日:2019-09-17

    申请号:US15163471

    申请日:2016-05-24

    Applicant: VMware, Inc.

    Abstract: Exemplary methods, apparatuses, and systems include a controller node receiving a request to perform a consistency check of a distributed file system. The controller node transmits, to each of a plurality of nodes, a request for the node to use logical metadata of the distributed file system owned by the node to construct an expected copy of physical metadata mapped to the logical metadata, determine which of the plurality of nodes own actual portions of the physical metadata, transmit corresponding portions of the expected copy of the physical metadata to each of the nodes determined to own actual portions of the physical metadata, and compare expected copies of the physical metadata received from other nodes to the actual physical metadata owned by the node. The controller node receives a result of the comparison from each of the nodes, aggregates the received results, and generates an error report.

Patent Agency Ranking