Heterogeneous accelerator for highly efficient learning systems

    公开(公告)号:US10474600B2

    公开(公告)日:2019-11-12

    申请号:US15825047

    申请日:2017-11-28

    Abstract: An apparatus may include a heterogeneous computing environment that may be controlled, at least in part, by a task scheduler in which the heterogeneous computing environment may include a processing unit having fixed logical circuits configured to execute instructions; a reprogrammable processing unit having reprogrammable logical circuits configured to execute instructions that include instructions to control processing-in-memory functionality; and a stack of high-bandwidth memory dies in which each may be configured to store data and to provide processing-in-memory functionality controllable by the reprogrammable processing unit such that the reprogrammable processing unit is at least partially stacked with the high-bandwidth memory dies. The task scheduler may be configured to schedule computational tasks between the processing unit, and the reprogrammable processing unit.

    COMPUTING ACCELERATOR USING A LOOKUP TABLE
    12.
    发明申请

    公开(公告)号:US20190212980A1

    公开(公告)日:2019-07-11

    申请号:US15916196

    申请日:2018-03-08

    Abstract: A computing accelerator using a lookup table. The accelerator may accelerate floating point multiplications by retrieving the fraction portion of the product of two floating-point operands from a lookup table, or by retrieving the product of two floating-point operands of two floating-point operands from a lookup table, or it may retrieve dot products of floating point vectors from a lookup table. The accelerator may be implemented in a three-dimensional memory assembly. It may use approximation, the symmetry of a multiplication lookup table, and zero-skipping to improve performance.

    Space-multiplexing DRAM-based reconfigurable logic
    14.
    发明授权
    Space-multiplexing DRAM-based reconfigurable logic 有权
    空间复用基于DRAM的可重构逻辑

    公开(公告)号:US09503095B2

    公开(公告)日:2016-11-22

    申请号:US14838348

    申请日:2015-08-27

    Abstract: According to one general aspect, an apparatus may include a random access memory array that, in turn, includes a reconfigurable look-up table. The reconfigurable look-up table may include memory cells configured to simultaneously store a plurality of look-up tables, wherein each look-up table is associated with a respective logic function. The reconfigurable look-up table may include a local row decoder configured to activate one or more rows of memory cells based upon a set of input signals. The reconfigurable look-up table may be configured to perform one logic function at a time, and wherein the logic function is dynamically selected. The plurality of look up tables stored in the memory cells may be configured to be dynamically altered via a write operation to the random access memory array.

    Abstract translation: 根据一个一般方面,装置可以包括随机存取存储器阵列,其又包括可重新配置的查找表。 可重构查找表可以包括被配置为同时存储多个查找表的存储器单元,其中每个查找表与相应的逻辑功能相关联。 可重构查找表可以包括配置成基于一组输入信号来激活一行或多行存储器单元的本地行解码器。 可重构查找表可以被配置为一次执行一个逻辑功能,并且其中逻辑功能被动态地选择。 存储在存储器单元中的多个查找表可以被配置为通过写入操作来动态地改变到随机存取存储器阵列。

    ADJUSTABLE FUNCTION-IN-MEMORY COMPUTATION SYSTEM

    公开(公告)号:US20240329872A1

    公开(公告)日:2024-10-03

    申请号:US18744351

    申请日:2024-06-14

    CPC classification number: G06F3/0655 G06F3/0604 G06F3/0673

    Abstract: A method for in-memory computing. In some embodiments, the method includes: executing, by a first function-in-memory circuit, a first instruction, to produce, as a result, a first value, wherein a first computing task includes a second computing task and a third computing task, the second computing task including the first instruction; storing, by the first function-in-memory circuit, the first value in a first buffer; reading, by a second function-in-memory circuit, the first value from the first buffer; and executing, by a second function-in-memory circuit, a second instruction, the second instruction using the first value as an argument, the third computing task including the second instruction, wherein: the storing, by the first function-in-memory circuit, of the first value in the first buffer includes directly storing the first value in the first buffer.

    SYSTEMS AND METHODS FOR DATA PLACEMENT FOR IN-MEMORY-COMPUTE

    公开(公告)号:US20240004646A1

    公开(公告)日:2024-01-04

    申请号:US18368515

    申请日:2023-09-14

    Abstract: According to one embodiment, a memory module includes: a memory die including a dynamic random access memory (DRAM) banks, each including: an array of DRAM cells arranged in pages; a row buffer to store values of one of the pages; an input/output (IO) module; and an in-memory compute (IMC) module including: an arithmetic logic unit (ALU) to receive operands from the row buffer or the IO module and to compute an output based on the operands and one of a plurality of ALU operations; and a result register to store the output of the ALU; and a controller to: receive, from a host processor, operands and an instruction; determine, based on the instruction, a data layout; supply the operands to the DRAM banks in accordance with the data layout; and control an IMC module to perform one of the ALU operations on the operands in accordance with the instruction.

    MEMORY LOOKUP COMPUTING MECHANISMS
    20.
    发明申请

    公开(公告)号:US20230101422A1

    公开(公告)日:2023-03-30

    申请号:US18060276

    申请日:2022-11-30

    Abstract: According to some example embodiments of the present disclosure, in a method for a memory lookup mechanism in a high-bandwidth memory system, the method includes: using a memory die to conduct a multiplication operation using a lookup table (LUT) methodology by accessing a LUT, which includes floating point operation results, stored on the memory die; sending, by the memory die, a result of the multiplication operation to a logic die including a processor and a buffer; and conducting, by the logic die, a matrix multiplication operation using computation units.

Patent Agency Ranking