METHOD AND APPARATUS FOR MONITORING MEMORY ACCESS TRAFFIC

    公开(公告)号:US20220100668A1

    公开(公告)日:2022-03-31

    申请号:US17094989

    申请日:2020-11-11

    Abstract: Methods and apparatus provide monitoring of memory access traffic in a data processing system by tracking, such as by data fabric hardware control logic, a number of cache line accesses to a page of memory associated with one or more memory devices, and producing spike indication data that indicates a spike in cache line accesses to a given page of memory. Pages are moved from a slower memory to a faster memory based on the spike indication data. In some implementations, the tracking is done by updating a cache directory with data representing the tracked number of cache line accesses.

    Method and apparatus for managing a cache directory

    公开(公告)号:US12271318B2

    公开(公告)日:2025-04-08

    申请号:US17135657

    申请日:2020-12-28

    Abstract: Method and apparatus monitor eviction conflicts among cache directory entries in a cache directory and produce cache directory victim entry information for a memory manager. In some examples, the memory manager reduces future cache directory conflicts by changing a page level physical address assignment for a page of memory based on the produced cache directory victim entry information. In some examples, a scalable data fabric includes hardware control logic that performs the monitoring of the eviction conflicts among cache directory entries in the cache directory and produces the cache directory victim entry information.

    IN-SWITCH EMBEDDING BAG POOLING
    6.
    发明申请

    公开(公告)号:US20250110899A1

    公开(公告)日:2025-04-03

    申请号:US18478659

    申请日:2023-09-29

    Abstract: An apparatus and method for reducing the memory bandwidth of executing machine learning models. A computing system includes two or more processing nodes, each including at least one or more processors and a corresponding local memory. Switch circuitry communicates with at least the local memories and a system memory of the computing system. The switch includes multiple direct memory access (DMA) interfaces. Each of one or more processing nodes stores multiple embedding rows of embedding tables. A processor of the processing node identifies two or more embedding rows as source operands of a reduction operation. The switch executes memory access requests to retrieve data of the two or more embedding rows from the corresponding local memory, and generates a result by performing the reduction operation. The switch sends the result to the local memory.

    ADAPTIVE MEMORY CONSISTENCY IN DISAGGREGATED DATACENTERS

    公开(公告)号:US20220317927A1

    公开(公告)日:2022-10-06

    申请号:US17219505

    申请日:2021-03-31

    Abstract: A data processor includes a fabric-attached memory (FAM) interface for coupling to a data fabric and fulfilling memory access instructions. A requestor-side adaptive consistency controller coupled to the FAM interface requests notifications from a fabric manager for the fabric-attached memory regarding changes in requestors authorized to access a FAM region which the data processor is authorized to access. If a notification indicates that more than one requestor is authorized to access the FAM region, fences are activated for selected memory access instructions in a local application.

    METHOD AND APPARATUS FOR MANAGING A CACHE DIRECTORY

    公开(公告)号:US20220206946A1

    公开(公告)日:2022-06-30

    申请号:US17135657

    申请日:2020-12-28

    Abstract: Method and apparatus monitor eviction conflicts among cache directory entries in a cache directory and produce cache directory victim entry information for a memory manager. In some examples, the memory manager reduces future cache directory conflicts by changing a page level physical address assignment for a page of memory based on the produced cache directory victim entry information. In some examples, a scalable data fabric includes hardware control logic that performs the monitoring of the eviction conflicts among cache directory entries in the cache directory and produces the cache directory victim entry information.

    Protecting host memory from access by untrusted accelerators

    公开(公告)号:US11030117B2

    公开(公告)日:2021-06-08

    申请号:US15650252

    申请日:2017-07-14

    Abstract: A host processor receives an address translation request from an accelerator, which may be trusted or un-trusted. The address translation request includes a virtual address in a virtual address space that is shared by the host processor and the accelerator. The host processor encrypts a physical address in a host memory indicated by the virtual address in response to the accelerator being permitted to access the physical address. The host processor then provides the encrypted physical address to the accelerator. The accelerator provides memory access requests including the encrypted physical address to the host processor, which decrypts the physical address and selectively accesses a location in the host memory indicated by the decrypted physical address depending upon whether the accelerator is permitted to access the location indicated by the decrypted physical address.

Patent Agency Ranking