Multi-tenant production and test deployments of Hadoop

    公开(公告)号:US10216758B2

    公开(公告)日:2019-02-26

    申请号:US14062723

    申请日:2013-10-24

    Applicant: VMware, Inc.

    Abstract: A distributed computing application is described that provides a highly elastic and multi-tenant platform for Hadoop applications and other workloads running in a virtualized environment. Production, test, and development deployments of a Hadoop application may be executed using multiple compute clusters and a shared instance of a distributed filesystem, or in other cases, multiple instances of the distributed filesystem. Data nodes executing as virtual machines (VMs) for test and development deployments can be linked clones of data nodes executing as VMs for a production deployment to reduce duplicated data and provide a shared storage space.

    HANDLING DISK STATE INHERITANCE FOR FORKED VIRTUAL MACHINES
    12.
    发明申请
    HANDLING DISK STATE INHERITANCE FOR FORKED VIRTUAL MACHINES 审中-公开
    处理虚拟机的处理盘状态

    公开(公告)号:US20170052812A1

    公开(公告)日:2017-02-23

    申请号:US15343454

    申请日:2016-11-04

    Applicant: VMware, Inc.

    Abstract: Techniques for handling inheritance of disk state when forking virtual machines (VMs) are provided. In one embodiment, a computer system can receive a request to fork a child VM from a parent VM. In response, the computer system can take a disk snapshot of the parent VM, where the disk snapshot results in a child disk for the child VM, where the child disk is a delta disk that points to a parent disk of the parent VM, and where the parent disk serves as the parent VM's current running point. The computer system can then determine whether the parent disk is a delta disk. If so, the computer system can copy the content of the parent disk to the child disk, traverse a disk hierarchy associated with the parent disk to identify a base disk above the parent disk in the hierarchy, and cause the child disk to point directly to the base disk.

    Abstract translation: 提供虚拟机(VM)时处理磁盘状态继承的技术。 在一个实施例中,计算机系统可以接收从父虚拟机分派子VM的请求。 作为响应,计算机系统可以获取父虚拟机的磁盘快照,其中磁盘快照导致子虚拟机的子磁盘,其中子磁盘是指向父虚拟机的父磁盘的增量磁盘,以及 父磁盘用作父虚拟机的当前运行点。 然后,计算机系统可以确定父磁盘是否是增量磁盘。 如果是这样,计算机系统可以将父磁盘的内容复制到子磁盘,遍历与父磁盘相关联的磁盘层次结构,以标识层次结构中父磁盘上方的基本磁盘,并使子磁盘直接指向 基盘。

    Fast Instantiation of Virtual Machines
    13.
    发明申请
    Fast Instantiation of Virtual Machines 审中-公开
    虚拟机的快速实例化

    公开(公告)号:US20150178108A1

    公开(公告)日:2015-06-25

    申请号:US14136661

    申请日:2013-12-20

    Applicant: VMware, Inc.

    CPC classification number: G06F9/45558 G06F2009/45562

    Abstract: Embodiments support instant forking of virtual machines (VMs) and state customization. Virtual device state and persistent storage of a child VM are defined based on virtual device state and persistent storage of parent VMs. After forking, a state of the child VM is customized based on configuration data. Customizing the state includes configuring one or more identities of the child VM, before bootup completes on the child VM.

    Abstract translation: 实施例支持即时分配虚拟机(VM)和状态定制。 基于虚拟设备状态和父虚拟机的持久存储来定义子虚拟机的虚拟设备状态和持久存储。 分叉后,基于配置数据定制子虚拟机的状态。 在子VM上启动完成之前,自定义状态包括配置子虚拟机的一个或多个身份。

    Parallel and distributed computing using multiple virtual machines

    公开(公告)号:US11429442B2

    公开(公告)日:2022-08-30

    申请号:US15195819

    申请日:2016-06-28

    Applicant: VMware, Inc.

    Abstract: Systems and techniques are described for using virtual machines to write parallel and distributed applications. One of the techniques includes receiving a job request, wherein the job request specifies a first job to be performed by a plurality of a special purpose virtual machines, wherein the first job includes a plurality of tasks; selecting a parent special purpose virtual machine from a plurality of parent special purpose virtual machines to perform the first job; instantiating a plurality of child special purpose virtual machines from the selected parent special purpose virtual machine; partitioning the plurality of tasks among the plurality of child special purpose virtual machines by assigning one or more of the plurality of tasks to each of the child special purpose virtual machines; and performing the first job by causing each of the child special purpose virtual machines to execute the tasks assigned to the child special purpose virtual machine.

    Container virtual machines for hadoop

    公开(公告)号:US10193963B2

    公开(公告)日:2019-01-29

    申请号:US14062660

    申请日:2013-10-24

    Applicant: VMware, Inc.

    Abstract: A distributed computing application is described that provides a highly elastic and multi-tenant platform for Hadoop applications and other workloads running in a virtualized environment. Data and compute nodes are separated into different virtual machines (VM). Compute VMs are used to launch containers from different tenants. Compute VMs are organized in pools of hot spare VMs that are immediately available for launching a container and executing a task, and pools of cold spare VMs. Each compute VM may include a mounted network filesystem provided by a node manager to share intermediate outputs across VMs executing on the same host.

    Parallel and Distributed Computing Using Multiple Virtual Machines
    16.
    发明申请
    Parallel and Distributed Computing Using Multiple Virtual Machines 审中-公开
    使用多个虚拟机的并行和分布式计算

    公开(公告)号:US20160378554A1

    公开(公告)日:2016-12-29

    申请号:US15195819

    申请日:2016-06-28

    Applicant: VMware, Inc.

    Abstract: Systems and techniques are described for using virtual machines to write parallel and distributed applications. One of the techniques includes receiving a job request, wherein the job request specifies a first job to be performed by a plurality of a special purpose virtual machines, wherein the first job includes a plurality of tasks; selecting a parent special purpose virtual machine from a plurality of parent special purpose virtual machines to perform the first job; instantiating a plurality of child special purpose virtual machines from the selected parent special purpose virtual machine; partitioning the plurality of tasks among the plurality of child special purpose virtual machines by assigning one or more of the plurality of tasks to each of the child special purpose virtual machines; and performing the first job by causing each of the child special purpose virtual machines to execute the tasks assigned to the child special purpose virtual machine.

    Abstract translation: 描述了使用虚拟机编写并行和分布式应用程序的系统和技术。 其中一种技术包括接收作业请求,其中作业请求指定由多个专用虚拟机执行的第一作业,其中第一作业包括多个任务; 从多个父专用虚拟机中选择父专用虚拟机来执行第一作业; 从所选择的父专用虚拟机中实例化多个子专用虚拟机; 通过将多个任务中的一个或多个分配给每个子专用虚拟机来分割多个子专用虚拟机中的多个任务; 并且通过使每个子专用虚拟机执行分配给子专用虚拟机的任务来执行第一作业。

Patent Agency Ranking