公开(公告)号：US10949252B1

公开(公告)日：2021-03-16

申请号：US15895747

申请日：2018-02-13

Applicant: Amazon Technologies, Inc.

Inventor： Sandeep Krishnamurthy ,  Jiajie Chen ,  Jonathan Esterhazy ,  Naveen Mysore Nagendra Swamy ,  Ruofei Yu ,  Yao Wang ,  Roshani Nagmote ,  Hagay Lupesko ,  Vikram Madan

IPC: G06F9/48 ,  G06N20/00

Abstract: Techniques for benchmarking a machine learning model/algorithm are described. For example, in some instances a method includes generating an execution plan for benchmarking of at least one task corresponding to a machine learning model based on an identified machine learning model, identified training data, and at least one objective for the benchmarking job; receiving execution statistics about the execution of the task as a part of the benchmarking job according to the execution plan; and updating the execution plan based at least in part on the received execution statistics of the task.