公开(公告)号：US20220114015A1

公开(公告)日：2022-04-14

申请号：US17195748

申请日：2021-03-09

申请人： Samsung Electronics Co., Ltd ,  SNU R&DB FOUNDATION

发明人： Seung Wook LEE ,  Younghwan OH ,  Jaewook LEE ,  Sam SON ,  Yunho JIN ,  Taejun HAM

IPC分类号： G06F9/48 ,  G06N5/04

摘要： A scheduler, a method of operating the scheduler, and an electronic device including the scheduler are disclosed. The method of operating the scheduler configured to determine a model to be executed in an accelerator includes receiving one or more requests for execution of a plurality of models to be independently executed in the accelerator, and performing layer-wise scheduling on the models based on an idle time occurring when a candidate layer which is a target for the scheduling in each of the models is executed in the accelerator

公开(公告)号：US20230143270A1

公开(公告)日：2023-05-11

申请号：US17887968

申请日：2022-08-15

申请人： Samsung Electronics Co., Ltd. ,  Seoul National University R&DB Foundation

发明人： Jae Wook LEE ,  Younghwan OH ,  Yunho JIN ,  Tae Jun HAM

IPC分类号： G06F9/48

CPC分类号： G06F9/4887

摘要： A processor-implemented method with scheduling includes: receiving one or more execution requests for a plurality of models executed independently of each other in an accelerator; predicting, for each of the plurality of models, quality of service (QoS) information corresponding to the model; and scheduling the plurality of models in units of layers of the plurality of models based on, for each of the plurality of models, either one or both of the QoS information and an idle time occurring in response to a candidate layer to be scheduled in the model being executed in the accelerator.