公开(公告)号：US20190340510A1

公开(公告)日：2019-11-07

申请号：US15967835

申请日：2018-05-01

Applicant: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP

Inventor： Sicheng Li ,  Cong Xu ,  Tsung Ching Huang

IPC: G06N3/08 ,  G06N3/04

Abstract: A technique includes modifying a neural network model to sparsify the model. The model includes a plurality of kernel element weights, which are parameterized according to a plurality of dimensions. Modifying the model includes, in a given iteration of the plurality of iterations, training the model based on a structure regularization in which kernel element weights that share a dimension in common are removed as a group to create corresponding zero kernel elements in the model; and compressing the model to exclude zero kernel element weights from the model to prepare the model to be trained in another iteration.

公开(公告)号：US11645529B2

公开(公告)日：2023-05-09

申请号：US15967835

申请日：2018-05-01

Applicant: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP

Inventor： Sicheng Li ,  Cong Xu ,  Tsung Ching Huang

IPC: G06V10/82 ,  G06N3/082 ,  G06N3/04 ,  G06N3/063

CPC classification number: G06N3/082 ,  G06N3/04 ,  G06N3/063

Abstract: A technique includes modifying a neural network model to sparsify the model. The model includes a plurality of kernel element weights, which are parameterized according to a plurality of dimensions. Modifying the model includes, in a given iteration of the plurality of iterations, training the model based on a structure regularization in which kernel element weights that share a dimension in common are removed as a group to create corresponding zero kernel elements in the model; and compressing the model to exclude zero kernel element weights from the model to prepare the model to be trained in another iteration.