GRADIENT-FREE STRUCTURED PRUNING OF NEURAL NETWORKS

    公开(公告)号:US20240289619A1

    公开(公告)日:2024-08-29

    申请号:US18424595

    申请日:2024-01-26

    Applicant: Google LLC

    CPC classification number: G06N3/082 G06N3/048

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing a machine learning task on a network input to generate a network output. One of the methods includes: obtaining data specifying an initial neural network configured to perform a machine learning task; a representativeness measure for each of a plurality of filters; determining a central tendency measure for the plurality of filters based on processing a batch of network inputs using the initial neural network; determining a cumulative importance score for each of the plurality of filters; selecting a proper subset of the plurality of filters; and generating a pruned neural network configured to perform the machine learning task.

Patent Agency Ranking