Neural architecture search system using training based on a weight-related metric

    公开(公告)号:US11836595B1

    公开(公告)日:2023-12-05

    申请号:US17816167

    申请日:2022-07-29

    Applicant: Lemon Inc.

    CPC classification number: G06N3/04 G06N3/08

    Abstract: Systems and methods for performing neural architecture search are provided. In one aspect, the system includes a processor configured to select a plurality of candidate neural networks within a search space, evaluate a performance of each of the plurality of candidate neural networks by: training each candidate neural network on a training dataset to perform the predetermined task and determining a ranking metric for each candidate neural network based on an objective function. The ranking metric includes a weight-related metric that is determined based on weights of a prediction layer of each respective candidate neural network before and after the respective candidate neural network is trained. The processor is configured to rank the plurality of candidate neural networks based on the determined ranking metrics.

Patent Agency Ranking