公开(公告)号：US09336035B2

公开(公告)日：2016-05-10

申请号：US13658567

申请日：2012-10-23

Applicant: VMware, Inc.

Inventor： Li Zhou ,  Samdeep Nayak ,  Sandeep Uttamchandani

IPC: G06F9/455 ,  G06F12/02

CPC classification number: G06F9/45558 ,  G06F9/45533 ,  G06F12/0246 ,  G06F2009/45579 ,  G06F2212/222 ,  G06F2212/7202 ,  G06F2212/7207

Abstract: Methods are presented for caching I/O data in a solid state drive (SSD) locally attached to a host computer supporting the running of a virtual machine (VM). Portions of the SSD are allocated as cache storage for VMs running on the host computer. A mapping relationship is maintained between unique identifiers for VMs running on the host computer and one or more process identifiers (PIDs) associated with processes running in the host computer that correspond to each of the VM's execution on the host computer. When an I/O request is received, a PID associated with I/O request is determined and a unique identifier for the VM is extracted from the mapping relationship based on the determined PID. A portion of the SSD corresponding to the unique identifier of the VM that is used as a cache for the VM can then be accessed in order to handle the I/O request.

Abstract translation: 提出了缓存本地连接到支持虚拟机（VM）运行的主计算机的固态驱动器（SSD）中的I / O数据的方法。 SSD的部分被分配为用于在主机上运行的VM的高速缓存存储器。 维护在主计算机上运行的VM的唯一标识符之间的映射关系，以及与在主计算机上运行的每个虚拟机在主计算机上执行的主机相关联的进程相关联的一个或多个进程标识符（PID）。 当接收到I / O请求时，确定与I / O请求相关联的PID，并且基于所确定的PID从映射关系中提取用于VM的唯一标识符。 然后可以访问与用作VM的高速缓存的VM的唯一标识符相对应的SSD的一部分，以便处理I / O请求。

公开(公告)号：US09280300B2

公开(公告)日：2016-03-08

申请号：US13931309

申请日：2013-06-28

Applicant: VMware, Inc.

Inventor： Deng Liu ,  Wei Zhang ,  Xiaoyun Zhu ,  Mayank Rawat ,  Sandeep Uttamchandani ,  Li Zhou ,  Jianzhe Tai

IPC: G06F3/00 ,  G06F3/06

CPC classification number: G06F3/0685 ,  G06F3/0604 ,  G06F3/061 ,  G06F3/0649

Abstract: Techniques for dynamically managing the placement of blocks of a logical file between a flash storage tier and an HDD storage tier are provided. In one embodiment, a computer system can collect I/O statistics pertaining to the logical file, where a first subset of blocks of the logical file are stored on the flash storage tier and where a second subset of blocks of the logical file are stored on the HDD storage tier. The computer system can further generate a heat map for the logical file based on the I/O statistics, where the heat map indicates, for each block of the logical file, the number of times the block has been accessed. The computer system can then identify, using the heat map, one or more blocks of the logical file as being performance-critical blocks, and can move data between the flash and HDD storage tiers such that the performance-critical blocks are placed on the flash storage tier.

Abstract translation: 提供了用于在闪存存储层和HDD存储层之间动态管理逻辑文件块的位置的技术。 在一个实施例中，计算机系统可以收集与逻辑文件相关的I / O统计信息，其中逻辑文件的块的第一子集存储在闪存存储层上，并且逻辑文件的块的第二子集存储在 HDD存储层。 计算机系统可以基于I / O统计信息进一步生成用于逻辑文件的热图，其中热图针对逻辑文件的每个块指示块被访问的次数。 计算机系统然后可以使用热图将逻辑文件的一个或多个块识别为性能关键块，并且可以在闪存和HDD存储层之间移动数据，使得性能关键块被放置在闪存上 存储层。

公开(公告)号：US20150120994A1

公开(公告)日：2015-04-30

申请号：US14592831

申请日：2015-01-08

Applicant: VMware, Inc.

Inventor： Sandeep Uttamchandani ,  Li Zhou ,  Fei Meng ,  Deng Liu

IPC: G06F3/06

CPC classification number: G06F3/061 ,  G06F3/0667 ,  G06F3/0685 ,  G06F9/5016 ,  G06F12/0246 ,  G06F12/0873 ,  G06F2009/45579 ,  G06F2212/152 ,  G06F2212/222 ,  G06F2212/6042

Abstract: Techniques for automatically allocating space in a flash storage-based cache are provided. In one embodiment, a computer system collects I/O trace logs for a plurality of virtual machines or a plurality of virtual disks and determines cache utility models for the plurality of virtual machines or the plurality of virtual disks based on the I/O trace logs. The cache utility model for each virtual machine or each virtual disk defines an expected utility of allocating space in the flash storage-based cache to the virtual machine or the virtual disk over a range of different cache allocation sizes. The computer system then calculates target cache allocation sizes for the plurality of virtual machines or the plurality of virtual disks based on the cache utility models and allocates space in the flash storage-based cache based on the target cache allocation sizes.

Abstract translation: 提供了在基于闪存存储的高速缓存中自动分配空间的技术。 在一个实施例中，计算机系统收集多个虚拟机或多个虚拟盘的I / O跟踪日志，并且基于I / O跟踪日志确定多个虚拟机或多个虚拟盘的高速缓存实用程序模型 。 每个虚拟机或每个虚拟磁盘的高速缓存实用程序模型定义了在基于闪存存储的高速缓存中将空间分配到不同高速缓存分配大小范围内的虚拟机或虚拟磁盘的预期效用。 计算机系统然后基于高速缓存实用程序模型计算多个虚拟机或多个虚拟磁盘的目标高速缓存分配大小，并基于目标高速缓存分配大小分配基于闪存存储器的高速缓存中的空间。

公开(公告)号：US09183016B2

公开(公告)日：2015-11-10

申请号：US13778441

申请日：2013-02-27

Applicant: VMware, Inc.

Inventor： Li Zhou ,  Sandeep Uttamchandani ,  Yizheng Chen

IPC: G06F9/455 ,  G06F9/50

CPC classification number: G06F9/455 ,  G06F9/45558 ,  G06F9/505 ,  G06F2009/45591 ,  G06F2209/503

Abstract: A control module is introduced to communicate with an application workload scheduler of a distributed computing application, such as a Job Tracker node of a Hadoop cluster, and with the virtualized computing environment underlying the application. The control module periodically queries for resource consumption data, such as CPU utilization, and uses the data to calculate how MapReduce task slots should be allocated on each task node of the Hadoop cluster. The control module passes the task slot allocation to the application workload scheduler, which honors the allocation by adjusting task assignments to task nodes accordingly. The task nodes may also activate and deactivate task slots according to the changed slot allocation. As a result, the distributed computing application is able to scale up and down when other workloads sharing the virtualized computing environment change.

Abstract translation: 引入控制模块以与分布式计算应用的应用工作负载调度器（例如Hadoop集群的作业跟踪器节点）以及应用程序的虚拟化计算环境进行通信。 控制模块定期查询资源消耗数据（如CPU利用率），并使用该数据计算如何在Hadoop集群的每个任务节点上分配MapReduce任务槽。 控制模块将任务时隙分配传递给应用程序工作负载调度程序，通过相应地调整任务分配来赋予分配权限。 任务节点还可以根据改变的时隙分配激活和去激活任务时隙。 因此，分布式计算应用程序能够在共享虚拟化计算环境的其他工作负载发生变化时上下放大。

公开(公告)号：US20140229638A1

公开(公告)日：2014-08-14

申请号：US13766605

申请日：2013-02-13

Applicant: VMWARE, INC.

Inventor： Li Zhou ,  Fei Meng ,  Sandeep Uttamchandani ,  Yea-Cheng Wang

IPC: G06F3/06

CPC classification number: G06F3/061 ,  G06F3/0635 ,  G06F3/0689

Abstract: Techniques for performing I/O load balancing are provided. In one embodiment, a computer system can receive an I/O request destined for a storage array, where the computer system is communicatively coupled with the storage array via a plurality of paths, and where the plurality of paths include a set of optimized paths and a set of unoptimized paths. The computer system can further determine whether the I/O request can be transmitted to the storage array via either an optimized path or an unoptimized path, or solely via an optimized path. The computer system can then select a path in the plurality of paths based on the determination and transmit the I/O request to the storage array via the selected path.

Abstract translation: 提供了执行I / O负载平衡的技术。 在一个实施例中，计算机系统可以接收去往存储阵列的I / O请求，其中计算机系统经由多个路径与存储阵列通信地耦合，并且其中多个路径包括一组优化的路径，以及 一套未优化的路径。 计算机系统可以进一步确定I / O请求是否可以经由优化的路径或未优化的路径，或者仅经由优化的路径发送到存储阵列。 计算机系统然后可以基于该确定来选择多个路径中的路径，并且经由所选择的路径将I / O请求发送到存储阵列。

公开(公告)号：US20140115228A1

公开(公告)日：2014-04-24

申请号：US13658567

申请日：2012-10-23

Applicant: VMWARE, INC.

Inventor： Li Zhou ,  Samdeep Nayak ,  Sandeep Uttamchandani

IPC: G06F12/02

CPC classification number: G06F9/45558 ,  G06F9/45533 ,  G06F12/0246 ,  G06F2009/45579 ,  G06F2212/222 ,  G06F2212/7202 ,  G06F2212/7207

Abstract: Methods are presented for caching I/O data in a solid state drive (SSD) locally attached to a host computer supporting the running of a virtual machine (VM). Portions of the SSD are allocated as cache storage for VMs running on the host computer. A mapping relationship is maintained between unique identifiers for VMs running on the host computer and one or more process identifiers (PIDs) associated with processes running in the host computer that correspond to each of the VM's execution on the host computer. When an I/O request is received, a PID associated with I/O request is determined and a unique identifier for the VM is extracted from the mapping relationship based on the determined PID. A portion of the SSD corresponding to the unique identifier of the VM that is used as a cache for the VM can then be accessed in order to handle the I/O request.

Abstract translation: 提出了缓存本地连接到支持虚拟机（VM）运行的主计算机的固态驱动器（SSD）中的I / O数据的方法。 SSD的部分被分配为用于在主机上运行的VM的高速缓存存储器。 维护在主计算机上运行的VM的唯一标识符之间的映射关系，以及与在主计算机上运行的每个虚拟机在主计算机上执行的主机相关联的进程相关联的一个或多个进程标识符（PID）。 当接收到I / O请求时，确定与I / O请求相关联的PID，并且基于所确定的PID从映射关系中提取用于VM的唯一标识符。 然后可以访问与用作VM的高速缓存的VM的唯一标识符相对应的SSD的一部分，以便处理I / O请求。

公开(公告)号：US10657101B2

公开(公告)日：2020-05-19

申请号：US15990360

申请日：2018-05-25

Applicant: VMware, Inc.

Inventor： Deng Liu ,  Sandeep Uttamchandani ,  Li Zhou ,  Mayank Rawat

IPC: G06F16/00 ,  G06F16/172 ,  G06F3/06 ,  G06F9/455 ,  G06F16/188

Abstract: Techniques for utilizing flash storage as an extension of hard disk (HDD) storage are provided. In one embodiment, a computer system stores a subset of blocks of a logical file in a first physical file, associated with a first data structure that represents a filesystem object, on flash storage and a subset of blocks, associated with a second data structure that represents a filesystem object comprising tiering configuration information that includes an identifier of the first physical file, in a second physical file on HDD storage. The computer system processes an I/O request directed to the logical file by directing it to either the physical file on the flash storage or the HDD storage by verifying that the tiering configuration information exists in the data structure and determining whether the one or more blocks are part of the first subset of blocks or the second subset of blocks.

公开(公告)号：US09182927B2

公开(公告)日：2015-11-10

申请号：US13931409

申请日：2013-06-28

Applicant: VMware, Inc.

Inventor： Deng Liu ,  Sandeep Uttamchandani ,  Li Zhou ,  Mayank Rawat

IPC: G06F3/00 ,  G06F3/06

CPC classification number: G06F3/0685 ,  G06F3/0604 ,  G06F3/0611 ,  G06F3/0655 ,  G06F3/0659 ,  G06F9/45558 ,  G06F2009/45579 ,  G06F2212/217

Abstract: Techniques for utilizing flash storage as an extension of hard disk (HDD) based storage are provided. In one embodiment, a computer system can store a first subset of blocks of a logical file in a first physical file residing on a flash storage tier, and a second subset of blocks of the logical file in a second physical file residing on an HDD storage tier. The computer system can then receive an I/O request directed to one or more blocks of the logical file and process the I/O request by accessing the flash storage tier or the HDD storage tier, the accessing being based on whether the one or more blocks are part of the first subset of blocks stored in the first physical file.

Abstract translation: 提供了使用闪存作为基于硬盘（HDD）的存储的扩展的技术。 在一个实施例中，计算机系统可以将存储在闪存存储层上的第一物理文件中的逻辑文件的块的第一子集存储在驻留在HDD存储器上的第二物理文件中的逻辑文件块的第二子集 层。 计算机系统然后可以接收针对逻辑文件的一个或多个块的I / O请求，并通过访问闪存存储层或HDD存储层来处理该I / O请求，该访问基于该一个或多个 块是存储在第一个物理文件中的块的第一个子集的一部分。

公开(公告)号：US08949531B2

公开(公告)日：2015-02-03

申请号：US13693976

申请日：2012-12-04

Applicant: VMware, Inc.

Inventor： Sandeep Uttamchandani ,  Li Zhou ,  Fei Meng ,  Deng Liu

IPC: G06F12/02 ,  G06F12/08 ,  G06F9/50

CPC classification number: G06F3/061 ,  G06F3/0667 ,  G06F3/0685 ,  G06F9/5016 ,  G06F12/0246 ,  G06F12/0873 ,  G06F2009/45579 ,  G06F2212/152 ,  G06F2212/222 ,  G06F2212/6042

Abstract: Techniques for automatically allocating space in a flash storage-based cache are provided. In one embodiment, a computer system collects I/O trace logs for a plurality of virtual machines or a plurality of virtual disks and determines cache utility models for the plurality of virtual machines or the plurality of virtual disks based on the I/O trace logs. The cache utility model for each virtual machine or each virtual disk defines an expected utility of allocating space in the flash storage-based cache to the virtual machine or the virtual disk over a range of different cache allocation sizes. The computer system then calculates target cache allocation sizes for the plurality of virtual machines or the plurality of virtual disks based on the cache utility models and allocates space in the flash storage-based cache based on the target cache allocation sizes.

Abstract translation: 提供了在基于闪存存储的高速缓存中自动分配空间的技术。 在一个实施例中，计算机系统收集多个虚拟机或多个虚拟盘的I / O跟踪日志，并且基于I / O跟踪日志确定多个虚拟机或多个虚拟盘的高速缓存实用程序模型 。 每个虚拟机或每个虚拟磁盘的高速缓存实用程序模型定义了在基于闪存存储的高速缓存中将空间分配到不同高速缓存分配大小范围内的虚拟机或虚拟磁盘的预期效用。 计算机系统然后基于高速缓存实用程序模型计算多个虚拟机或多个虚拟磁盘的目标高速缓存分配大小，并基于目标高速缓存分配大小分配基于闪存存储器的高速缓存中的空间。

公开(公告)号：US08930592B2

公开(公告)日：2015-01-06

申请号：US13766605

申请日：2013-02-13

Applicant: VMware, Inc.

Inventor： Li Zhou ,  Fei Meng ,  Sandeep Uttamchandani ,  Yea-Cheng Wang

IPC: G06F3/00 ,  G06F3/06

CPC classification number: G06F3/061 ,  G06F3/0635 ,  G06F3/0689

Abstract: Techniques for performing I/O load balancing are provided. In one embodiment, a computer system can receive an I/O request destined for a storage array, where the computer system is communicatively coupled with the storage array via a plurality of paths, and where the plurality of paths include a set of optimized paths and a set of unoptimized paths. The computer system can further determine whether the I/O request can be transmitted to the storage array via either an optimized path or an unoptimized path, or solely via an optimized path. The computer system can then select a path in the plurality of paths based on the determination and transmit the I/O request to the storage array via the selected path.

Abstract translation: 提供了执行I / O负载平衡的技术。 在一个实施例中，计算机系统可以接收去往存储阵列的I / O请求，其中计算机系统经由多个路径与存储阵列通信地耦合，并且其中多个路径包括一组优化的路径，以及 一套未优化的路径。 计算机系统可以进一步确定I / O请求是否可以经由优化的路径或未优化的路径，或者仅经由优化的路径发送到存储阵列。 计算机系统然后可以基于该确定来选择多个路径中的路径，并且经由所选择的路径将I / O请求发送到存储阵列。