公开(公告)号：US20240037373A1

公开(公告)日：2024-02-01

申请号：US17875594

申请日：2022-07-28

Applicant: Google LLC

Inventor： Sheng Li ,  Norman Paul Jouppi ,  Garrett Axel Andersen ,  Quoc V. Le ,  Liqun Cheng ,  Parthasarathy Ranganathan

IPC: G06N3/04 ,  G06N3/063

CPC classification number: G06N3/0454 ,  G06N3/063

Abstract: Aspects of the disclosure are directed to jointly searching machine learning model architectures and hardware architectures in a combined space of models, hardware, and mapping strategies. A search strategy is utilized where all models, hardware, and mappings are evaluated together at once via weight sharing and a supernetwork. A multi-objective reward function is utilized with objectives for quality, performance, power, and area.

公开(公告)号：US20230297580A1

公开(公告)日：2023-09-21

申请号：US17721873

申请日：2022-04-15

Applicant: Google LLC

Inventor： Sheng Li ,  Garrett Axel Andersen ,  Norman Paul Jouppi ,  Quoc V. Le ,  Liqun Cheng ,  Parthasarathy Ranganathan ,  Julian Paul Grady ,  Yang Li ,  Martin Wicke ,  Yifeng Lu ,  Yun Ni ,  Kun Wang

IPC: G06F16/2457 ,  G06F16/2455 ,  G06N3/063

CPC classification number: G06F16/2457 ,  G06F16/24554 ,  G06N3/063

Abstract: According to various implementations, generally disclosed herein is a hybrid and hierarchical neural architecture search (NAS) approach. The approach includes performing a search space partitioning scheme to divide the search space into sub-search spaces. The approach further includes performing a first type of NAS, such as a Multi-trial NAS, to cover a search across the sub-search spaces. The approach also includes performing a second type of NAS, such as a One-Shot NAS, to cover each sub-search space. The approach further includes automatically stopping the second type of NAS based on one or more early stopping criteria.