公开(公告)号：US20230297696A1

公开(公告)日：2023-09-21

申请号：US18185654

申请日：2023-03-17

申请人： NVIDIA Corporation

发明人： Philip Rogers ,  Mark Overby ,  Vyas Venkataraman ,  Naveen Cherukuri ,  James Leroy Deming ,  Gobikrishna Dhanuskodi ,  Dwayne Swoboda ,  Lucien Dunning ,  Aruna Manjunatha ,  Aaron Jiricek ,  Mark Hairgrove ,  Michael Woodmansee

IPC分类号： G06F21/60 ,  G06F9/455 ,  G06F21/57

CPC分类号： G06F21/602 ,  G06F9/45558 ,  G06F21/575 ,  G06F2009/45587

摘要： In examples, a parallel processing unit (PPU) operates within a trusted execution environment (TEE) implemented using a central processing unit (CPU). A virtual machine (VM) executing within the TEE is provided access to the PPU by a hypervisor. However, data of an application executed by the VM is inaccessible to the hypervisor and other untrusted entities outside of the TEE. To protect the data in transit, the VM and the PPU may encrypt or decrypt the data for secure communication between the devices. To protect the data within the PPU, a protected memory region may be created in PPU memory where compute engines of the PPU are prevented from writing outside of the protected memory region. A write protect memory region is generated where access to the PPU memory is blocked from other computing devices and/or device instances.

公开(公告)号：US11487673B2

公开(公告)日：2022-11-01

申请号：US14055345

申请日：2013-10-16

申请人： NVIDIA Corporation

发明人： Jerome F. Duluk, Jr. ,  Cameron Buschardt ,  Sherry Cheung ,  James Leroy Deming ,  Samuel H. Duncan ,  Lucien Dunning ,  Robert George ,  Arvind Gopalakrishnan ,  Mark Hairgrove ,  Chenghuan Jia ,  John Mashey

IPC分类号： G06F13/12 ,  G06F13/38 ,  G06F12/1009 ,  G06F12/109 ,  G06F12/1072 ,  G06F12/08 ,  G06F11/07 ,  G06F12/12 ,  G06F12/10

摘要： A system for managing virtual memory. The system includes a first processing unit configured to execute a first operation that references a first virtual memory address. The system also includes a first memory management unit (MMU) associated with the first processing unit and configured to generate a first page fault upon determining that a first page table that is stored in a first memory unit associated with the first processing unit does not include a mapping corresponding to the first virtual memory address. The system further includes a first copy engine associated with the first processing unit. The first copy engine is configured to read a first command queue to determine a first mapping that corresponds to the first virtual memory address and is included in a first page state directory. The first copy engine is also configured to update the first page table to include the first mapping.

公开(公告)号：US10546361B2

公开(公告)日：2020-01-28

申请号：US15709397

申请日：2017-09-19

申请人： NVIDIA Corporation

发明人： Stephen Jones ,  Vivek Kini ,  Piotr Jaroszynski ,  Mark Hairgrove ,  David Fontaine ,  Cameron Buschardt ,  Lucien Dunning ,  John Hubbard

IPC分类号： G06F13/14 ,  G06T1/20 ,  G06F9/50 ,  G06F12/109 ,  G06T1/60

摘要： The present invention facilitates efficient and effective utilization of unified virtual addresses across multiple components. In one exemplary implementation, an address allocation process comprises: establishing space for managed pointers across a plurality of memories, including allocating one of the managed pointers with a first portion of memory associated with a first one of a plurality of processors; and performing a process of automatically managing accesses to the managed pointers across the plurality of processors and corresponding memories. The automated management can include ensuring consistent information associated with the managed pointers is copied from the first portion of memory to a second portion of memory associated with a second one of the plurality of processors based upon initiation of an accesses to the managed pointers from the second one of the plurality of processors.

公开(公告)号：US20190147561A1

公开(公告)日：2019-05-16

申请号：US16237010

申请日：2018-12-31

申请人： Nvidia Corporation

发明人： Stephen Jones ,  Vivek Kini ,  Piotr Jaroszynski ,  Mark Hairgrove ,  David Fontaine ,  Cameron Buschardt ,  Lucien Dunning ,  John Hubbard

IPC分类号： G06T1/20 ,  G06F9/50 ,  G06F12/109 ,  G06T1/60

摘要： The present invention facilitates efficient and effective utilization of unified virtual addresses across multiple components. In one exemplary implementation, an address allocation process comprises: establishing space for managed pointers across a plurality of memories, including allocating one of the managed pointers with a first portion of memory associated with a first one of a plurality of processors; and performing a process of automatically managing accesses to the managed pointers across the plurality of processors and corresponding memories. The automated management can include ensuring consistent information associated with the managed pointers is copied from the first portion of memory to a second portion of memory associated with a second one of the plurality of processors based upon initiation of an accesses to the managed pointers from the second one of the plurality of processors.

公开(公告)号：US10133677B2

公开(公告)日：2018-11-20

申请号：US14133489

申请日：2013-12-18

申请人： NVIDIA CORPORATION

发明人： Jerome F. Duluk, Jr. ,  Cameron Buschardt ,  James Leroy Deming ,  Lucien Dunning ,  Brian Fahs ,  Mark Hairgrove ,  John Mashey

IPC分类号： G06F12/12 ,  G06F12/122 ,  G06F12/08 ,  G06F12/1009

摘要： Techniques are disclosed for transitioning a memory page between memories in a virtual memory subsystem. A unified virtual memory (UVM) driver detects a page fault in response to a memory access request associated with a first memory page, where a local page table does not include an entry corresponding to a virtual memory address included in the memory access request. The UVM driver, in response to the page fault, executes a page fault sequence. The page fault sequence includes modifying the ownership state associated with the first memory page to be central-processing-unit-shared. The page fault sequence further includes scheduling the first memory page for migration from a system memory associated with a central processing unit (CPU) to a local memory associated with a parallel processing unit (PPU). One advantage of the disclosed approach is that the PPU accesses memory pages with greater efficiency.

公开(公告)号：US10037228B2

公开(公告)日：2018-07-31

申请号：US13660763

申请日：2012-10-25

申请人： NVIDIA Corporation

发明人： Nick Barrow-Williams ,  Brian Fahs ,  Jerome F. Duluk, Jr. ,  James Leroy Deming ,  Timothy John Purcell ,  Lucien Dunning ,  Mark Hairgrove

IPC分类号： G06F12/00 ,  G06F9/50 ,  G06F12/1045 ,  G06F12/109

CPC分类号： G06F9/5027 ,  G06F12/1036 ,  G06F12/1045 ,  G06F12/109

摘要： A technique for simultaneously executing multiple tasks, each having an independent virtual address space, involves assigning an address space identifier (ASID) to each task and constructing each virtual memory access request to include both a virtual address and the ASID. During virtual to physical address translation, the ASID selects a corresponding page table, which includes virtual to physical address mappings for the ASID and associated task. Entries for a translation look-aside buffer (TLB) include both the virtual address and ASID to complete each mapping to a physical address. Deep scheduling of tasks sharing a virtual address space may be implemented to improve cache affinity for both TLB and data caches.

公开(公告)号：US09767036B2

公开(公告)日：2017-09-19

申请号：US14055318

申请日：2013-10-16

申请人： NVIDIA Corporation

发明人： Jerome F. Duluk, Jr. ,  Cameron Buschardt ,  Sherry Cheung ,  James Leroy Deming ,  Samuel H. Duncan ,  Lucien Dunning ,  Robert George ,  Arvind Gopalakrishnan ,  Mark Hairgrove ,  Chenghuan Jia ,  John Mashey

IPC分类号： G06F12/10 ,  G06F12/1009 ,  G06F12/109 ,  G06F12/1072 ,  G06F11/07 ,  G06F12/12 ,  G06F12/08

CPC分类号： G06F12/1009 ,  G06F11/073 ,  G06F11/0793 ,  G06F12/08 ,  G06F12/10 ,  G06F12/1072 ,  G06F12/109 ,  G06F12/12 ,  G06F2212/1016

摘要： A system for managing virtual memory. The system includes a first processing unit configured to execute a first operation that references a first virtual memory address. The system also includes a first memory management unit (MMU) associated with the first processing unit and configured to generate a first page fault upon determining that a first page table that is stored in a first memory unit associated with the first processing unit does not include a mapping corresponding to the first virtual memory address. The system further includes a first copy engine associated with the first processing unit. The first copy engine is configured to read a first command queue to determine a first mapping that corresponds to the first virtual memory address and is included in a first page state directory. The first copy engine is also configured to update the first page table to include the first mapping.

公开(公告)号：US20160188251A1

公开(公告)日：2016-06-30

申请号：US14800684

申请日：2015-07-15

申请人： Nvidia Corporation

发明人： Lucien Dunning ,  Dwayne Swoboda ,  Arvind Gopalakrishnan ,  Cameron Buschardt

IPC分类号： G06F3/06 ,  G06F12/10

CPC分类号： G06F12/1009 ,  G06F12/109 ,  G06F12/1491 ,  G06F2212/1044 ,  G06F2212/152

摘要： Unified virtual memory (UVM) management techniques using page table sharing between user mode and kernel mode GPU address spaces and creating the notion of privileged level of data.

摘要翻译： 统一虚拟内存（UVM）管理技术，使用用户模式和内核模式之间的页表共享GPU地址空间，并创建特权数据级别的概念。