FEDERATED LEARNING USING HETEROGENEOUS MODEL TYPES AND ARCHITECTURES

    公开(公告)号:US20220351039A1

    公开(公告)日:2022-11-03

    申请号:US17766025

    申请日:2019-10-04

    IPC分类号: G06N3/08

    摘要: A method on a central node or server is provided. The method includes: receiving a first model from a first user device and a second model from a second user device, wherein the first model is of a neural network model type and has a first set of layers and the second model is of the neural network model type and has a second set of layers different from the first set of layers; for each layer of the first set of layers, selecting a first subset of filters from the layer of the first set of layers, for each layer of the second set of layers, selecting a second subset of filters from the layer of the second set of layers; constructing a global model by forming a global set of layers based on the first set of layers and the second set of layers, such that for each layer in the global set of layers, the layer comprises filters based on the corresponding first subset of filters and/or the corresponding second subset of filters; and forming a fully connected layer for the global model, wherein the fully connected layer is a final layer of the global set of layers.