公开(公告)号：US11899588B2

公开(公告)日：2024-02-13

申请号：US17175607

申请日：2021-02-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Anshujit Sharma ,  Sushant Kondguli ,  Zhenhong Liu ,  Wilson Wai Lun Fung ,  Arun Radhakrishnan ,  Wayne Yamamoto

IPC: G06F12/00 ,  G06F12/0875 ,  G06F12/02 ,  G06T1/60 ,  G06T1/20

CPC classification number: G06F12/0875 ,  G06F12/0269 ,  G06T1/20 ,  G06T1/60 ,  G06F2212/604

Abstract: A graphics processing unit (GPU) includes a table located in a memory of the GPU and a cache hierarchy. The table contains an address of inactive data in a cache hierarchy of the GPU in which the inactive data is associated with an intermediate render target. The cache hierarchy is responsive to an eviction event by discarding the inactive data from the cache hierarchy without performing a writeback to a system memory associated with the GPU based on the address of the inactive data being contained in the table. The cache hierarchy may obtain the address of the inactive data from the table, and the inactive data may be located in a last-level cache of the cache hierarchy. In one embodiment, the address of inactive data in a cache hierarchy of the GPU includes a range of addresses for the inactive data.

公开(公告)号：US10540287B2

公开(公告)日：2020-01-21

申请号：US15690931

申请日：2017-08-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Edward A Brekelbaum ,  Arun Radhakrishnan

IPC: G06F12/00 ,  G06F12/0862 ,  G06F9/30 ,  G06F9/38 ,  G06F12/0811 ,  G06F12/0875 ,  G06N20/00 ,  G06F3/06

Abstract: Apparatuses and methods of manufacturing same, systems, and methods for a spatial memory streaming (SMS) prefetch engine are described. In one aspect, the SMS prefetch engine includes a pattern history table (PHT), which has a table in which each entry has an offset list field comprising sub-fields for offset values from a base offset value within a region and a per-offset confidence field comprising sub-fields for per-offset confidence levels corresponding to each offset value. When a PHT entry is activated, the per-offset confidence values corresponding to each offset value in the offset list field of the PHT entry are updated by matching current accesses to the stored offset values in the offset list field of the activated PHT entry. Continuous learning may be provided to the SMS engine at least by the per-offset confidence levels.

公开(公告)号：US20170116128A1

公开(公告)日：2017-04-27

申请号：US15401515

申请日：2017-01-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Karthik Sundaram ,  Arun Radhakrishnan

IPC: G06F12/0862 ,  G06F12/0875

CPC classification number: G06F12/0862 ,  G06F9/30043 ,  G06F9/3802 ,  G06F9/383 ,  G06F9/3836 ,  G06F12/0875 ,  G06F12/1027 ,  G06F2212/452 ,  G06F2212/6028 ,  G06F2212/657 ,  Y02D10/13

Abstract: A computing system includes: an instruction dispatch module module configured to receive a program instruction; and an address reordering module, coupled to the instruction dispatch module, configured to filter the program instruction when the program instruction is a hit in a cache-line in a prefetch filter. The computer system further includes: an instruction dispatch module configured to receive a program instruction; an address reordering module, coupled to the instruction dispatch module, configured to: allocate a tag in a tag module for the program instruction in a program order, allocate a virtual address in a virtual address module for the program instruction and out-of-order relative to the program order, and insert a pointer associated with the tag to link the tag to the virtual address.

公开(公告)号：US10417130B2

公开(公告)日：2019-09-17

申请号：US15729068

申请日：2017-10-10

Applicant: Samsung Electronics Co., Ltd.

Inventor： Edward A Brekelbaum ,  Arun Radhakrishnan

IPC: G06F12/00 ,  G06F12/0862 ,  G06F9/30 ,  G06F9/38 ,  G06F12/0811 ,  G06F12/0875 ,  G06N20/00

Abstract: Apparatuses, systems, methods for a spatial memory streaming (SMS) prefetch engine are described. In one aspect, an SMS prefetch engine uses trigger-to-trigger stride detection to promote training table entries to pattern history table (PHT) entries and to drive spatially related prefetches in more distant regions. In another aspect, an SMS prefetch engine maintains a blacklist of program counter (PC) values to not use as trigger values. In yet another aspect, an SMS prefetch engine uses hashed values of certain fields, such as the trigger PC, in entries of, e.g., filter tables, training tables, and PHTs, as index values for the table.

公开(公告)号：US11610281B2

公开(公告)日：2023-03-21

申请号：US17146491

申请日：2021-01-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Sushant Kondguli ,  Arun Radhakrishnan ,  Zachary D. Neyland ,  David C. Tannenbaum

IPC: G06F12/0897 ,  G06T1/60 ,  G06F12/0877 ,  G06F9/50 ,  G06N20/00 ,  G06F11/34 ,  G06T1/20 ,  G06F11/30

Abstract: A method of processing a workload in a graphics processing unit (GPU) may include detecting a work item of the workload in the GPU, determining a cache policy for the work item, and operating at least a portion of a cache memory hierarchy in the GPU for at least a portion of the work item based on the cache policy. The work item may be detected based on information received from an application and/or monitoring one or more performance counters by a driver and/or hardware detection logic. The method may further include monitoring one or more performance counters, wherein the cache policy for the work item may be determined and/or changed based on the one or more performance counters. The cache policy for the work item may be selected based on a runtime learning model.

公开(公告)号：US10031851B2

公开(公告)日：2018-07-24

申请号：US15401515

申请日：2017-01-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Karthik Sundaram ,  Arun Radhakrishnan

IPC: G06F12/00 ,  G06F12/0862 ,  G06F12/0875 ,  G06F12/1027

Abstract: A computing system includes: an instruction dispatch module module configured to receive a program instruction; and an address reordering module, coupled to the instruction dispatch module, configured to filter the program instruction when the program instruction is a hit in a cache-line in a prefetch filter. The computer system further includes: an instruction dispatch module configured to receive a program instruction; an address reordering module, coupled to the instruction dispatch module, configured to: allocate a tag in a tag module for the program instruction in a program order, allocate a virtual address in a virtual address module for the program instruction and out-of-order relative to the program order, and insert a pointer associated with the tag to link the tag to the virtual address.

公开(公告)号：US09569361B2

公开(公告)日：2017-02-14

申请号：US14325343

申请日：2014-07-07

Applicant: Samsung Electronics Co., Ltd.

Inventor： Arun Radhakrishnan ,  Kevin Lepak ,  Rama Gopal ,  Murali Chinnakonda ,  Karthik Sundaram ,  Brian Grayson

IPC: G06F12/08

CPC classification number: G06F12/0862 ,  G06F12/10 ,  G06F2212/6022

Abstract: According to one general aspect, an apparatus may include a cache pre-fetcher, and a pre-fetch scheduler. The cache pre-fetcher may be configured to predict, based at least in part upon a virtual address, data to be retrieved from a memory system. The pre-fetch scheduler may be configured to convert the virtual address of the data to a physical address of the data, and request the data from one of a plurality of levels of the memory system. The memory system may include a plurality of levels, each level of the memory system configured to store data.

Abstract translation: 根据一个一般方面，设备可以包括高速缓存预取器和预取调度器。 高速缓存预取器可以被配置为至少部分地基于虚拟地址预测要从存储器系统检索的数据。 预取调度器可以被配置为将数据的虚拟地址转换为数据的物理地址，并且从存储器系统的多个级别之一请求数据。 存储器系统可以包括多个级别，存储器系统的每个级别被配置为存储数据。

公开(公告)号：US20150278100A1

公开(公告)日：2015-10-01

申请号：US14498878

申请日：2014-09-26

Applicant: Samsung Electronics Co., Ltd.

Inventor： Karthik Sundaram ,  Arun Radhakrishnan

IPC: G06F12/08 ,  G06F12/10

CPC classification number: G06F12/0862 ,  G06F9/30043 ,  G06F9/3802 ,  G06F9/383 ,  G06F9/3836 ,  G06F12/0875 ,  G06F12/1027 ,  G06F2212/452 ,  G06F2212/6028 ,  G06F2212/657 ,  Y02D10/13

Abstract: A computing system includes: an instruction dispatch module configured to receive a program instruction; an address reordering module, coupled to the instruction dispatch module, configured to filter the program instruction when the program instruction is a hit in a cache-line in a prefetch filter. The computer system further includes: an instruction dispatch module configured to receive a program instruction; an address reordering module, coupled to the instruction dispatch module, configured to: allocate a tag in a tag module for the program instruction in a program order, allocate a virtual address in a virtual address module for the program instruction in an out-of-order relative to the program order, and insert a pointer associated with the tag to link the tag to the virtual address.

Abstract translation: 计算系统包括：指令调度模块，被配置为接收程序指令; 耦合到指令调度模块的地址重排序模块，被配置为当所述程序指令是预取过滤器中的高速缓存行中的命中时对所述程序指令进行过滤。 计算机系统还包括：指令调度模块，被配置为接收程序指令; 一个地址重排序模块，耦合到指令调度模块，被配置为：以程序顺序在程序指令的标签模块中分配标签，在虚拟地址模块中为程序指令分配虚拟地址， 相对于程序顺序的顺序，并插入与标签相关联的指针，以将标签链接到虚拟地址。

公开(公告)号：US20180329822A1

公开(公告)日：2018-11-15

申请号：US15690931

申请日：2017-08-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Edward A. BREKELBAUM ,  Arun Radhakrishnan

IPC: G06F12/0862 ,  G06F12/0875 ,  G06F12/0811 ,  G06F9/38 ,  G06F9/30 ,  G06N99/00

Abstract: Apparatuses and methods of manufacturing same, systems, and methods for a spatial memory streaming (SMS) prefetch engine are described. In one aspect, the SMS prefetch engine includes a pattern history table (PHT), which has a table in which each entry has an offset list field comprising sub-fields for offset values from a base offset value within a region and a per-offset confidence field comprising sub-fields for per-offset confidence levels corresponding to each offset value. When a PHT entry is activated, the per-offset confidence values corresponding to each offset value in the offset list field of the PHT entry are updated by matching current accesses to the stored offset values in the offset list field of the activated PHT entry. Continuous learning may be provided to the SMS engine at least by the per-offset confidence levels.

公开(公告)号：US09542323B2

公开(公告)日：2017-01-10

申请号：US14498878

申请日：2014-09-26

Applicant: Samsung Electronics Co., Ltd.

Inventor： Karthik Sundaram ,  Arun Radhakrishnan

IPC: G06F12/00 ,  G06F12/08 ,  G06F9/38

CPC classification number: G06F12/0862 ,  G06F9/30043 ,  G06F9/3802 ,  G06F9/383 ,  G06F9/3836 ,  G06F12/0875 ,  G06F12/1027 ,  G06F2212/452 ,  G06F2212/6028 ,  G06F2212/657 ,  Y02D10/13

Abstract: A computing system includes: an instruction dispatch module configured to receive a program instruction; an address reordering module, coupled to the instruction dispatch module, configured to filter the program instruction when the program instruction is a hit in a cache-line in a prefetch filter. The computer system further includes: an instruction dispatch module configured to receive a program instruction; an address reordering module, coupled to the instruction dispatch module, configured to: allocate a tag in a tag module for the program instruction in a program order, allocate a virtual address in a virtual address module for the program instruction in an out-of-order relative to the program order, and insert a pointer associated with the tag to link the tag to the virtual address.

Abstract translation: 计算系统包括：指令调度模块，被配置为接收程序指令; 耦合到指令调度模块的地址重排序模块，被配置为当所述程序指令是预取过滤器中的高速缓存行中的命中时对所述程序指令进行过滤。 计算机系统还包括：指令调度模块，被配置为接收程序指令; 一个地址重排序模块，耦合到指令调度模块，被配置为：以程序顺序在程序指令的标签模块中分配标签，在虚拟地址模块中为程序指令分配虚拟地址， 相对于程序顺序的顺序，并插入与标签相关联的指针，以将标签链接到虚拟地址。