MULTI-LEVEL ACCESS CONTROL FOR DISTRIBUTED STORAGE SYSTEMS

    公开(公告)号:US20190050583A1

    公开(公告)日:2019-02-14

    申请号:US16153633

    申请日:2018-10-05

    Applicant: VMware, Inc.

    CPC classification number: G06F21/604 G06F21/6272

    Abstract: System and method for accessing a distributed storage system uses a storage-level access control process at a distributed file system that interfaces with the distributed storage system to determine whether a particular client has access to a particular first file system object using an identifier of the particular client and storage-level access control rules in response to a file system request from the particular client to access a second file system object in the particular first file system. The storage-level access control rules are defined for a plurality of clients and a plurality of first file system objects of the distributed storage system to allow the particular client access to the second file system object in the particular first file system object only if the particular client has been determined to have access to the particular first file system object according to the storage-level access control rules.

    ABORTABLE TRANSACTIONS USING VERSIONED TUPLE CACHE
    2.
    发明申请
    ABORTABLE TRANSACTIONS USING VERSIONED TUPLE CACHE 审中-公开
    使用VERSIONED TUPLE CACHE的可移动交易

    公开(公告)号:US20160378815A1

    公开(公告)日:2016-12-29

    申请号:US14752175

    申请日:2015-06-26

    Applicant: VMware, Inc.

    Abstract: A transaction manager for handling operations on data in a storage system provides a system for executing transactions that uses a versioned tuple cache to achieve fast, abortable transactions using a redo-only log. The transaction manager updates an in-memory key-value store and also attaches a transaction identifier to the tuple as a minor key. Opportunistic locking can be accomplished due to the low cost of aborting transactions.

    Abstract translation: 用于处理存储系统中的数据操作的事务管理器提供用于执行使用版本化的元组高速缓存以使用仅重做日志来实现快速,可中止事务的事务的系统。 事务管理器更新内存中键值存储,并将事务标识符附加到元组作为次要密钥。 由于中止交易的成本低,可以实现机会锁定。

    SCALABLE SPACE MANAGEMENT USING BITMAP SUMMARY TREE
    3.
    发明申请
    SCALABLE SPACE MANAGEMENT USING BITMAP SUMMARY TREE 审中-公开
    使用BITMAP总结树的可扩展空间管理

    公开(公告)号:US20160334997A1

    公开(公告)日:2016-11-17

    申请号:US14713698

    申请日:2015-05-15

    Applicant: VMware, Inc.

    Abstract: Systems and methods for allocating space in persistent storage are provided. A modified bitmap and a tree of bitmap summary pages are used to manage the free space of a large scale storage system. The bitmap is separated into fixed size pages and has bitmap summary entries to summarize the information in the bitmap. Bitmap summary pages can be further summarized into secondary summary pages. The tree data structure can continue to N levels until a topmost level has one bitmap summary page.

    Abstract translation: 提供了在持久存储器中分配空间的系统和方法。 使用修改后的位图和位图摘要页面树来管理大型存储系统的可用空间。 位图被分成固定大小的页面,并且具有位图摘要条目以总结位图中的信息。 位图摘要页面可以进一步汇总到次要摘要页面中。 树数据结构可以继续N级,直到最顶层具有一个位图摘要页。

    MULTI-TENANT DISTRIBUTED COMPUTING AND DATABASE
    4.
    发明申请
    MULTI-TENANT DISTRIBUTED COMPUTING AND DATABASE 审中-公开
    多重分配计算和数据库

    公开(公告)号:US20150121371A1

    公开(公告)日:2015-04-30

    申请号:US14329132

    申请日:2014-07-11

    Applicant: VMware, Inc.

    Abstract: A distributed computing application is described that provides a highly elastic and multi-tenant platform for Hadoop applications and other workloads running in a virtualized environment. Deployments of a distributed computing application, such as Hadoop, may be executed concurrently with a distributed database application, such as HBase, using a shared instance of a distributed filesystem, or in other cases, multiple instances of the distributed filesystem. Computing resources allocated to region server nodes executing as VMs may be isolated from compute VMs of the distributed computing application, as well as from data nodes executing as VMs of the distributed filesystem.

    Abstract translation: 描述了一种分布式计算应用程序,为Hadoop应用程序和在虚拟化环境中运行的其他工作负载提供了高弹性和多租户平台。 分布式计算应用程序(如Hadoop)的部署可以与分布式数据库应用程序(例如HBase)一起使用分布式文件系统的共享实例或其他情况下分布式文件系统的多个实例同时执行。 分配给作为VM执行的区域服务器节点的计算资源可以与分布式计算应用的计算VM以及作为分布式文件系统的VM执行的数据节点隔离。

    Virtualization-Aware Data Locality in Distributed Data Processing
    5.
    发明申请
    Virtualization-Aware Data Locality in Distributed Data Processing 有权
    分布式数据处理中的虚拟化感知数据位置

    公开(公告)号:US20140059310A1

    公开(公告)日:2014-02-27

    申请号:US13907393

    申请日:2013-05-31

    Applicant: VMware, Inc.

    Abstract: A virtualized computing system for executing a distributed computing application, such as Hadoop, is discussed. The virtualized computing system stores data in a distributed filesystem, such as Hadoop Distributed File System, and processes data using a topology awareness that takes into account the virtualization layer of the virtualized computing system. The virtualized computing system employs locality-related policies, including replica placement policies, replica choosing policies, balancer policies, and task scheduling policies that take advantage of the awareness of the virtualization topology.

    Abstract translation: 讨论了用于执行诸如Hadoop的分布式计算应用的虚拟化计算系统。 虚拟化计算系统将数据存储在诸如Hadoop分布式文件系统之类的分布式文件系统中,并使用考虑到虚拟化计算系统的虚拟化层的拓扑感知来处理数据。 虚拟化计算系统采用与地理相关的策略,包括复制放置策略,副本选择策略,平衡器策略以及利用虚拟化拓扑的意识的任务调度策略。

    FAST FILE CLONE USING COPY-ON-WRITE B-TREE
    6.
    发明申请
    FAST FILE CLONE USING COPY-ON-WRITE B-TREE 有权
    使用COPY-ON-B B-TREE的快速文件

    公开(公告)号:US20170060898A1

    公开(公告)日:2017-03-02

    申请号:US14837166

    申请日:2015-08-27

    Applicant: VMware, Inc.

    CPC classification number: G06F17/30327 G06F3/06 G06F17/30091

    Abstract: A file system uses a B-tree data structure to organize file data. The file system may maintain an index node (mode) representing a file and having entries that map to extents of the file. When the file system detects an index node, through updates, has exceeded a threshold number of extents, the file system converts the file to a copy-on-write (COW) B-tree data structure containing the entries representing the extents of the file. To clone the file, the file system uses copies of the index node and the root node of the COW B-tree data structure.

    Abstract translation: 文件系统使用B树数据结构来组织文件数据。 文件系统可以维护表示文件的索引节点(模式),并具有映射到文件的范围的条目。 当文件系统检测到索引节点时,通过更新,已经超过阈值数量级,文件系统将该文件转换为包含表示文件扩展区的条目的写入时复制(COW)B树数据结构 。 要克隆文件,文件系统使用索引节点和COW B树数据结构的根节点的副本。

    LOG-STRUCTURED B-TREE FOR HANDLING RANDOM WRITES
    7.
    发明申请
    LOG-STRUCTURED B-TREE FOR HANDLING RANDOM WRITES 有权
    用于处理随机写入的结构化B-TREE

    公开(公告)号:US20160378653A1

    公开(公告)日:2016-12-29

    申请号:US14750554

    申请日:2015-06-25

    Applicant: VMware, Inc.

    CPC classification number: G06F12/0866 G06F12/0804 G06F2212/463 G06F2212/466

    Abstract: A sorted key-value store is implemented using a write-back cache maintained in memory, a B-tree data structured maintained in disk, and a logical and physical log for providing transactions. The logical log and write-back cache are used to answer client requests, while dirty blocks in the write-back cache are periodically flushed to disk using the physical log.

    Abstract translation: 使用在存储器中保存的回写高速缓存,结构化维护在磁盘中的B树数据以及用于提供事务的逻辑和物理日志来实现排序的键值存储。 逻辑日志和回写缓存用于回答客户端请求,而回写缓存中的脏块会使用物理日志定期刷新到磁盘。

    MULTI-TENANT PRODUCTION AND TEST DEPLOYMENTS OF HADOOP
    8.
    发明申请
    MULTI-TENANT PRODUCTION AND TEST DEPLOYMENTS OF HADOOP 审中-公开
    多样性生产和测试部署HADOOP

    公开(公告)号:US20150120791A1

    公开(公告)日:2015-04-30

    申请号:US14062723

    申请日:2013-10-24

    Applicant: VMWARE, INC.

    CPC classification number: G06F17/30194 G06F9/45558 G06F2009/45575

    Abstract: A distributed computing application is described that provides a highly elastic and multi-tenant platform for Hadoop applications and other workloads running in a virtualized environment. Production, test, and development deployments of a Hadoop application may be executed using multiple compute clusters and a shared instance of a distributed filesystem, or in other cases, multiple instances of the distributed filesystem. Data nodes executing as virtual machines (VMs) for test and development deployments can be linked clones of data nodes executing as VMs for a production deployment to reduce duplicated data and provide a shared storage space.

    Abstract translation: 描述了一种分布式计算应用程序,为Hadoop应用程序和在虚拟化环境中运行的其他工作负载提供了高弹性和多租户平台。 Hadoop应用程序的生产,测试和开发部署可以使用多个计算集群和分布式文件系统的共享实例,或者其他情况下分布式文件系统的多个实例来执行。 作为用于测试和开发部署的虚拟机(VM))执行的数据节点可以是作为生产部署的VM执行的数据节点的链接克隆,以减少重复的数据并提供共享存储空间。

Patent Agency Ranking