公开(公告)号：US20230401427A1

公开(公告)日：2023-12-14

申请号：US18457002

申请日：2023-08-28

Applicant: Intel Corporation

Inventor： Qutub Syed Sha ,  Neslihan Kose Cihangir ,  Rafael Rosales

IPC: G06N3/045

CPC classification number: G06N3/045

Abstract: Deep neural networks (DNNs) with budding ensemble architectures may be trained using diversity loss. A DNN may include a backbone and a plurality of heads. The backbone includes one or more layers. A layer in the backbone may generate an intermediate tensor. The plurality of heads may include one or more pairs of heads. A pair of heads includes a first head and a second head duplicated from the first head. The second head may include the same tensor operations as the first head but different internal parameters. The intermediate tensor generated by a backbone layer may be input into both the first head and the second head. The first head may compute a first detection tensor, and the second head may compute a second detection tensor. A similarity between the first detection tensor and the second detection tensor may be used as a diversity loss for training the DNN.