Storage device and method of operating the same

    公开(公告)号:US12050988B2

    公开(公告)日:2024-07-30

    申请号:US18310008

    申请日:2023-05-01

    CPC classification number: G06N3/063 G06F9/5016 G06F9/5061 G06F12/10

    Abstract: A method of operating a storage device including a neural network processor includes outputting, by a controller device, a trigger signal instructing the neural network processor to perform a neural network operation in response to a command from a host device, requesting, by a neural network processor, target model data about parameters of a target model and instruction data for instructing the neural network operation to a memory device storing the target model data and the instruction data in response to the trigger signal, receiving, by the neural network processor, the target model data and the instruction data from the memory device and outputting, by the neural network processor, inference data based on the target model data and the instruction data.

    SCHEDULING OF A PLURALITY OF GRAPHIC PROCESSING UNITS

    公开(公告)号:US20240248759A1

    公开(公告)日:2024-07-25

    申请号:US18628102

    申请日:2024-04-05

    CPC classification number: G06F9/5022 G06F9/5061 G06T1/20 G06F2209/5011

    Abstract: The present disclosure provides a method and apparatus for scheduling a plurality of available graphics processing units (GPUs). Multiple GPU pools may be set, wherein each GPU pool is configured to serve one or more jobs requiring the same number of GPUs. Available GPUs may be assigned to each GPU pool. A job and job information related to the job may be received, wherein the job information indicates a number of GPUs required for performing the job. A corresponding GPU pool may be selected from the multiple GPU pools based at least on the job information. Available GPUs to be scheduled to the job in the selected GPU pool may be determined based at least on the job information. In addition, the determined available GPUs may be scheduled to the job.

    Resource Access Control
    16.
    发明公开

    公开(公告)号:US20240220265A1

    公开(公告)日:2024-07-04

    申请号:US18147103

    申请日:2022-12-28

    CPC classification number: G06F9/3836 G06F9/4806 G06F9/5061

    Abstract: Resource access control is described. In accordance with the described techniques, a process (e.g., an application process, a system process, etc.) issues an instruction seeking access to a computation resource (e.g., a processor resource, a memory resource, etc.) to perform a computation task. An execution context for the instruction is checked to determine whether the execution context includes a resource indicator indicating permission to access the processor resource. Alternatively or additionally, the instruction is checked against an access table which identifies processes that are permitted and/or not permitted to access the computation resource.

    SYSTEM FOR MANAGING HARDWARE CONTAINERIZATION FRAMEWORK

    公开(公告)号:US20240193001A1

    公开(公告)日:2024-06-13

    申请号:US18527414

    申请日:2023-12-04

    CPC classification number: G06F9/5061

    Abstract: System and method for managing hardware containerization in a wireless network architecture, are described. In one aspect, capability information of a plurality of hardware units is transmitted to a host processor to select a set of hardware units in a system-on-chip (SoC). Configuration information that includes the selection of one or more hardware allocation parameters and one or more types of statistics for one or more processing flows is received by the selected set of hardware units. A hardware container is configured to enable SoC resource allocation related to a control group and a namespace of SoC resources via a plurality of hardware modules in the SoC. The hardware container is managed based on periodic collection and analysis of the statistical data via a plurality of instrumentation modules in the SoC, and the impact on the one or more processing flows is tracked at the host processor.

Patent Agency Ranking