公开(公告)号：US11816509B2

公开(公告)日：2023-11-14

申请号：US16742108

申请日：2020-01-14

Applicant: VMware, Inc.

Inventor： Hari Sivaraman ,  Uday Pundalik Kurkure ,  Lan Vu

IPC: G06F9/50 ,  G06F9/54 ,  G06F9/30 ,  G06N3/045

CPC classification number: G06F9/5077 ,  G06F9/30029 ,  G06F9/5011 ,  G06F9/5083 ,  G06F9/546 ,  G06N3/045

Abstract: Disclosed are aspects of workload selection and placement in systems that include graphics processing units (GPUs) that are virtual GPU (vGPU) enabled. In some aspects, workloads are assigned to virtual graphics processing unit (vGPU)-enabled graphics processing units (GPUs) based on a variety of vGPU placement models. A number of vGPU placement neural networks are trained to maximize a composite efficiency metric based on workload data and GPU data for the plurality of vGPU placement models. A combined neural network selector is generated using the vGPU placement neural networks, and utilized to assign a workload to a vGPU-enabled GPU.

公开(公告)号：US11579942B2

公开(公告)日：2023-02-14

申请号：US16890156

申请日：2020-06-02

Applicant: VMware, Inc.

Inventor： Uday Pundalik Kurkure ,  Hari Sivaraman ,  Lan Vu

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/455 ,  G06T1/20 ,  G06F9/48

Abstract: Disclosed are aspects of virtual graphics processing unit (vGPU) scheduling-aware virtual machine migration. Graphics processing units (GPUs) that are compatible with a current virtual GPU (vGPU) profile for a virtual machine are identified. A scheduling policy matching order for a migration of the virtual machine is determined based on a current vGPU scheduling policy for the virtual machine. A destination GPU is selected based on a vGPU scheduling policy of the destination GPU being identified as a best available vGPU scheduling policy according to the scheduling policy matching order. The virtual machine is migrated to the destination GPU.

公开(公告)号：US20220237014A1

公开(公告)日：2022-07-28

申请号：US17224293

申请日：2021-04-07

Applicant: VMWARE, INC.

Inventor： UDAY PUNDALIK KURKURE ,  Sairam Veeraswamy ,  Hari Sivaraman ,  Lan Vu ,  Avinash Kumar Chaurasia

IPC: G06F9/455 ,  G06F9/50 ,  G06T1/20

Abstract: Disclosed are aspects of network function placement in virtual graphics processing unit (vGPU)-enabled environments. In one example a network function request is associated with a network function. A scheduler selects a vGPU-enabled GPU to handle the network function request. The vGPU-enabled GPU is selected in consideration of a network function memory requirement or a network function IO requirement. The network function request is processed using an instance of the network function within a virtual machine that is executed using the selected vGPU-enabled GPU.

公开(公告)号：US11113782B2

公开(公告)日：2021-09-07

申请号：US16601831

申请日：2019-10-15

Applicant: VMware, Inc.

Inventor： Chandra Prakash ,  Anshuj Garg ,  Uday Pundalik Kurkure ,  Hari Sivaraman ,  Lan Vu ,  Sairam Veeraswamy

IPC: G06T1/20 ,  G06F9/455 ,  G06F9/48

Abstract: Various examples are disclosed for dynamic kernel slicing for virtual graphics processing unit (vGPU) sharing in serverless computing systems. A computing device is configured to provide a serverless computing service, receive a request for execution of program code in the serverless computing service in which a plurality of virtual graphics processing units (vGPUs) are used in the execution of the program code, determine a slice size to partition a compute kernel of the program code into a plurality of sub-kernels for concurrent execution by the vGPUs, the slice size being determined for individual ones of the sub-kernels based on an optimization function that considers a load on a GPU, determine an execution schedule for executing the individual ones of the sub-kernels on the vGPUs in accordance with a scheduling policy, and execute the sub-kernels on the vGPUs as partitioned in accordance with the execution schedule.

公开(公告)号：US20170097837A1

公开(公告)日：2017-04-06

申请号：US15380977

申请日：2016-12-15

Applicant: VMware, Inc.

Inventor： Lan Vu ,  Hari Sivaraman ,  Rishi Bidarkar

IPC: G06F9/455 ,  G06F9/44

CPC classification number: G06F9/45525 ,  G06F9/4484 ,  G06F9/50 ,  G06F9/545 ,  G06F2209/542

Abstract: Systems and techniques are described for modifying an executable file of an application and executing the application using the modified executable file. A described technique includes receiving, by a virtual machine, a request to perform an initial function of an application and an executable file for the application. The virtual machine modifies the executable file by redirecting the executable file to a custom runtime library that includes a custom function configured to initialize the application and to place the application in a paused state. A custom function call is added to the custom function in the executable file. The virtual machine initializes the application by executing the modified executable file, the executing causing the custom function to initialize the application and place the application in a paused state.

公开(公告)号：US20240036937A1

公开(公告)日：2024-02-01

申请号：US18483100

申请日：2023-10-09

Applicant: VMware, Inc.

Inventor： Hari Sivaraman ,  Uday Pundalik Kurkure ,  Lan Vu

IPC: G06F9/50 ,  G06F9/54 ,  G06F9/30 ,  G06N3/045

CPC classification number: G06F9/5077 ,  G06F9/5011 ,  G06F9/546 ,  G06F9/30029 ,  G06F9/5083 ,  G06N3/045

Abstract: Disclosed are aspects of workload selection and placement in systems that include graphics processing units (GPUs) that are virtual GPU (vGPU) enabled. In some aspects, workloads are assigned to virtual graphics processing unit (vGPU)-enabled graphics processing units (GPUs). A number of vGPU placement neural networks are trained to maximize a composite efficiency metric based on workload data and GPU data for the plurality of vGPU placement models. A combined neural network selector is generated using the vGPU placement neural networks, and utilized to assign a workload to a vGPU-enabled GPU.

公开(公告)号：US11586842B2

公开(公告)日：2023-02-21

申请号：US16823139

申请日：2020-03-18

Applicant: VMware, Inc.

Inventor： Lan Vu ,  Hari Sivaraman ,  Uday Pundalik Kurkure ,  Xuwen Yu

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/00

Abstract: A system and method for assessing video quality of a video-based application trains a neural network using training data of video samples and assesses video of the video-based application using the neural network to generate the subjective video quality information of the video-based application. Data augmentation is performed on video data, which is labeled with at least one subjective quality level, to generate the training data of video samples.

公开(公告)号：US11372683B2

公开(公告)日：2022-06-28

申请号：US16550313

申请日：2019-08-26

Applicant: VMWARE, INC.

Inventor： Anshuj Garg ,  Uday Pundalik Kurkure ,  Hari Sivaraman ,  Lan Vu

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/455

Abstract: Disclosed are aspects of memory-aware placement in systems that include graphics processing units (GPUs) that are virtual GPU (vGPU) enabled. Virtual graphics processing unit (vGPU) data is identified for graphics processing units (GPUs). A configured GPU list and an unconfigured GPU list are generated using the GPU data. The configured GPU list specifies configured vGPU profiles for configured GPUs. The unconfigured GPU list specifies a total GPU memory for unconfigured GPUs. A vGPU request is assigned to a vGPU of a GPU. The GPU is a first fit, from the configured GPU list or the unconfigured GPU list that satisfies a GPU memory requirement of the vGPU request.

公开(公告)号：US11282179B2

公开(公告)日：2022-03-22

申请号：US16823162

申请日：2020-03-18

Applicant: VMware, Inc.

Inventor： Lan Vu ,  Hari Sivaraman ,  Uday Pundalik Kurkure ,  Xuwen Yu

IPC: G06T7/00 ,  G06K9/00 ,  G06K9/62 ,  H04L65/80 ,  G06N3/08

Abstract: A system and method for assessing video quality of a video-based application inserts frame identifiers (IDs) into video content from the video-based application and recognizes the frame IDs from the video content using a text recognition neural network. Based on recognized frame IDs, a frame per second (FPS) metric of the video content is calculated. Based on the FPS metric of the video content, objective video quality of the video-based application is assessed.

公开(公告)号：US11263040B2

公开(公告)日：2022-03-01

申请号：US16882942

申请日：2020-05-26

Applicant: VMware, Inc.

Inventor： Hari Sivaraman ,  Uday Pundalik Kurkure ,  Lan Vu

IPC: G06F9/455 ,  G06F9/48 ,  G06F9/50

Abstract: Various examples are disclosed for generating heatmaps and plotting utilization of hosts in a datacenter environment. A collector virtual machine can rove the datacenter and collect utilization data. The utilization data can be plotted on a heatmap to illustrate utilization hotspots in the datacenter environment.