SCHEDULING OF INFERENCE MODELS BASED ON PREEMPTABLE BOUNDARIES

    公开(公告)号:US20230252328A1

    公开(公告)日:2023-08-10

    申请号:US18153764

    申请日:2023-01-12

    CPC classification number: G06N5/048 G06F9/4818

    Abstract: Disclosed herein are systems and methods for inference model scheduling of a multi priority inference model system. A processor determines an interrupt flag has been set indicative of a request to interrupt execution of a first inference model in favor of a second inference model. In response to determining that the interrupt flag has been set, the processor determines a state of the execution of the first inference model based on one or more factors. In response to determining the state of the execution is at a preemptable boundary, the processor deactivates the first inference model and activates the second inference model.

Patent Agency Ranking