MULTI-TRACK MACHINE LEARNING MODEL TRAINING USING EARLY TERMINATION IN CLOUD-SUPPORTED PLATFORMS

    公开(公告)号:US20230342666A1

    公开(公告)日:2023-10-26

    申请号:US18139016

    申请日:2023-04-25

    CPC classification number: G06N20/00

    Abstract: Devices, systems, and techniques for experiment-based training of machine learning models (MLMs) using early stopping. The techniques include starting training tracks (TTs) that train candidate MLMs using the same training data and respective sets of training settings, performing a first evaluation of a first candidate MLM prior to completion of a corresponding first TT, and responsive to the first evaluation, placing the first TT on an inactive status, inactive status indicating that further training of the first candidate MLM is to be ceased. The techniques further include continuing at least a second TT using the training data, and responsive to conclusion of the TTs, selecting, as one or more final MLMs, the first candidate MLM or a second candidate MLM.

    TRANSFER LEARNING FOR NEURAL NETWORKS

    公开(公告)号:US20210089921A1

    公开(公告)日:2021-03-25

    申请号:US17029725

    申请日:2020-09-23

    Abstract: Transfer learning can be used to enable a user to obtain a machine learning model that is fully trained for an intended inferencing task without having to train the model from scratch. A pre-trained model can be obtained that is relevant for that inferencing task. Additional training data, as may correspond to at least one additional class of data, can be used to further train this model. This model can then be pruned and retrained in order to obtain a smaller model that retains high accuracy for the intended inferencing task.

    PRUNING NEURAL NETWORKS THAT INCLUDE ELEMENT-WISE OPERATIONS

    公开(公告)号:US20200160185A1

    公开(公告)日:2020-05-21

    申请号:US16197986

    申请日:2018-11-21

    Abstract: Input layers of an element-wise operation in a neural network can be pruned such that the shape (e.g., the height, the width, and the depth) of the pruned layers matches. A pruning engine identifies all of the input layers into the element-wise operation. For each set of corresponding neurons in the input layers, the pruning engine equalizes the metrics associated with the neurons to generate an equalized metric associated with the set. The pruning engine prunes the input layers based on the equalized metrics generated for each unique set of corresponding neurons.

Patent Agency Ranking