SELECTING AND USING A CLOUD-BASED HARDWARE ACCELERATOR

    公开(公告)号:US20210152424A1

    公开(公告)日:2021-05-20

    申请号:US17128041

    申请日:2020-12-19

    IPC分类号: H04L12/24 H04L29/08

    摘要: A cloud-based hardware accelerator is selected by deploying an accelerator image to first and second clouds to generate first and second cloud-based hardware accelerators, executing a first request on the first and second cloud-based hardware accelerators, monitoring characteristics of the first and second cloud-based hardware accelerators executing the first request, which may include execution time and monetary cost, and selecting one of the first and second hardware accelerators according to defined selection criteria. Subsequent requests are then routed to the selected cloud-based accelerator.

    Helping a hardware accelerator using software

    公开(公告)号:US10725839B2

    公开(公告)日:2020-07-28

    申请号:US16034074

    申请日:2018-07-12

    IPC分类号: G06F9/54

    摘要: An accelerator helper monitors pending calls for a first accelerator, and when the accelerator is too busy, the accelerator helper sends a new call to the first accelerator to a software routine instead of to the first accelerator. The software routine processes the new call in parallel with the first accelerator processing a previous call. When the accelerator is not too busy, the accelerator helper sends to the first accelerator the new call to the first accelerator. The determination of when the accelerator is too busy can be whether a number of pending calls for the first accelerator exceeds a predetermined threshold. The accelerator helper speeds up execution of calls to the first accelerator by executing some calls to the accelerator in a software routine when the first accelerator has too many calls pending.

    How to track operator behavior via metadata

    公开(公告)号:US10657033B2

    公开(公告)日:2020-05-19

    申请号:US14796491

    申请日:2015-07-10

    IPC分类号: G06F11/36 H04L12/26

    摘要: Embodiments presented herein describe techniques for tracking operators of a distributed computing environment (e.g., a streams processing environment) using metadata. During execution of a distributed application of the computing environment, a tracker tool monitors a plurality of operators of the distributed application. Each of the operators stores one or more specified metadata values associated with the operator. For each operator, the tracker tool retrieves the one or more specified metadata values associated with the operator. Upon determining that one of the one or more specified metadata values do not comply with a corresponding expected metadata value, the tracker tool generates an indicator for the operator. The indicator includes information describing the one or more specified metadata values.

    ACCELERATOR VALIDATION AND REPORTING
    6.
    发明申请

    公开(公告)号:US20200050490A1

    公开(公告)日:2020-02-13

    申请号:US16059917

    申请日:2018-08-09

    IPC分类号: G06F9/50 G06F9/455

    摘要: An accelerator manager validates an accelerator image using one or more suitable validation methods, which may include comparing results of running an accelerator with results of simulating the accelerator, comparing results of running an accelerator on two different programmable devices, and deploying the accelerator to a cloud of an accelerator provider and running the accelerator to determine whether the accelerator meets defined specifications. The accelerator manager can also report information about one or more accelerators to an accelerator provider and/or to a provider of a programmable device.

    MEMORY MANAGEMENT IN A PROGRAMMABLE DEVICE
    7.
    发明申请

    公开(公告)号:US20200042210A1

    公开(公告)日:2020-02-06

    申请号:US16049829

    申请日:2018-07-31

    IPC分类号: G06F3/06 G06F12/14 G06F9/50

    摘要: A memory manager on a programmable device manages memory allocated to accelerators on the programmable device and allocated to processes that access the programmable device. The memory manager can manage both memory on the programmable device as well as external memory coupled to the programmable device. The memory manager protects the memory from unauthorized access by enforcing protection for the memory, using keys, encryption or the like. The memory manger can allocate a partition of memory to an accelerator when an accelerator is deployed to a programmable device, then allocate subpartitions within the allocated partition for each process that accesses the accelerator. When an accelerator is cast out of the programmable device, the memory partition is scrubbed so it can be reclaimed and allocated to another accelerator. When a process terminates, the subpartitions corresponding to the process are scrubbed so they may be reclaimed and allocated to another process.

    ACCELERATOR MONITORING AND TESTING
    8.
    发明申请

    公开(公告)号:US20200026630A1

    公开(公告)日:2020-01-23

    申请号:US16041949

    申请日:2018-07-23

    摘要: An accelerator manager monitors and logs performance of multiple accelerators, analyzes the logged performance, determines from the logged performance of a selected accelerator a desired programmable device for the selected accelerator, and specifies the desired programmable device to one or more accelerator developers. The accelerator manager can further analyze the logged performance of the accelerators, and generate from the analyzed logged performance an ordered list of test cases, ordered from fastest to slowest. A test case is selected, and when the estimated simulation time for the selected test case is less than the estimated synthesis time for the test case, the test case is simulated and run. When the estimated simulation time for the selected test case is greater than the estimated synthesis time for the text case, the selected test case is synthesized and run.

    DYNAMIC ACCELERATOR GENERATION AND DEPLOYMENT

    公开(公告)号:US20200019443A1

    公开(公告)日:2020-01-16

    申请号:US16033960

    申请日:2018-07-12

    IPC分类号: G06F9/50 G06F9/38

    摘要: An accelerator deployment tool deploys multiple accelerators to multiple programmable devices, and detects when a new programmable device becomes available. When a first accelerator in a first programmable device is a better match to the new programmable device, the accelerator deployment tool automatically generates an image for the first accelerator for the new programmable device, deploys the image on the new programmable device to generate a second accelerator, changes references to the first accelerator to reference instead the second accelerator, and casts the first accelerator out of the first programmable device.

    ACCELERATOR MANAGEMENT
    10.
    发明申请

    公开(公告)号:US20190332564A1

    公开(公告)日:2019-10-31

    申请号:US15964115

    申请日:2018-04-27

    IPC分类号: G06F13/42 G06F9/445 G06F13/16

    摘要: An accelerator manager manages multiple accelerators in multiple programmable devices. An accelerator cast out policy specifies criteria for casting out accelerators in the programmable devices. The accelerator manager monitors usage of the accelerators by one or more computer programs, and generates a historical log from the monitored usage. When the conditions in the historical log satisfy criteria in the accelerator cast out policy for casting out an accelerator, the accelerator manager casts out the accelerator, and updates a virtual function table to replace calls to the accelerator that was cast out with calls to the software library.