Invention Application
- Patent Title: AUTOMATICALLY AND EFFICIENTLY GENERATING SEARCH SPACES FOR NEURAL NETWORK
-
Application No.: US17348246Application Date: 2021-06-15
-
Publication No.: US20220398450A1Publication Date: 2022-12-15
- Inventor: Xiaojie JIN , Daquan Zhou , Xiaochen Lian , Linjie Yang , Jiashi Feng
- Applicant: Lemon Inc.
- Applicant Address: KY Grand Cayman
- Assignee: Lemon Inc.
- Current Assignee: Lemon Inc.
- Current Assignee Address: KY Grand Cayman
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/12

Abstract:
A super-network comprising a plurality of layers may be generated. Each layer may comprise cells with different structures. A predetermined number of cells from each layer may be selected. A plurality of cells may be generated based on selected cells using a local mutation model, wherein the local mutation model comprises a mutation window for removing redundant edges from each selected cell. Performance of the plurality of cells may be evaluated using a differentiable fitness scoring function. The operations of the generating a plurality of cells using the local mutation model, the evaluating performance of the plurality of cells using the differentiable fitness scoring function and the selecting the subset of cells based on the evaluation results may be iteratively performed until the super-network converges. A search space for each layer may be generated based on a predetermined top number of cells with largest fitness scores after the super-network converges.
Information query