Hierarchical machine learning system for lifelong learning

    公开(公告)号:US10162794B1

    公开(公告)日:2018-12-25

    申请号:US15914955

    申请日:2018-03-07

    申请人: Apprente, Inc.

    IPC分类号: G06F15/18 G06K9/62

    摘要: Embodiments described herein cover a hierarchical machine learning system with a separated perception subsystem (that includes a hierarchy of nodes having at least a first layer and a second layer) and application subsystem. In one example embodiment a first node in the first layer processes a first input and processes at least a portion of the first input to generate a first feature vector. A second node in the second layer processes a second input comprising at least a portion of the first feature vector to generate a second feature vector. The first node generates a first sparse feature vector from the first feature vector and/or the second node generates a second sparse feature vector from the second feature vector. A third node of the perception subsystem then processes at least one of the first sparse feature vector or the second sparse feature vector to determine an output.

    Machine learning architecture for lifelong learning

    公开(公告)号:US10055685B1

    公开(公告)日:2018-08-21

    申请号:US15785270

    申请日:2017-10-16

    申请人: Apprente, Inc.

    IPC分类号: G06N3/08 G06N3/04

    CPC分类号: G06N3/08 G06N3/0427 G06N20/00

    摘要: Some embodiments described herein cover a machine learning architecture with a separated perception subsystem and application subsystem. These subsystems can be co-trained. In one example embodiment, a data item is received and information from the data item is processed by a first node to generate a first feature vector comprising a plurality of features, each of the plurality of features having a similarity value representing a similarity to one of a plurality of centroids. The first node selects a subset of the features from the first feature vector, the subset containing one or more features that have highest similarity values. The first node generates a second feature vector from the first feature vector by replacing similarity values of features in the first feature vector that are not in the subset with zeros. A second node then processes the second feature vector to determine an output.

    Machine learning architecture for lifelong learning

    公开(公告)号:US11205122B1

    公开(公告)日:2021-12-21

    申请号:US16038061

    申请日:2018-07-17

    申请人: Apprente, Inc.

    IPC分类号: G06N3/08 G06N3/04

    摘要: Some embodiments described herein cover a machine learning architecture with a separated perception subsystem and application subsystem. These subsystems can be co-trained. In one example embodiment, a data item is received and information from the data item is processed by a first node to generate a sparse feature vector. A second node processes the sparse feature vector to determine an output. A relevancy rating associated with the output is determined. A determination is made as to whether to update the first node based on update criteria associated with the first node, wherein the update criteria comprise a relevancy criterion and a novelty criterion. The second node is updated based on the relevancy rating.

    Conversational agent pipeline trained on synthetic data

    公开(公告)号:US10210861B1

    公开(公告)日:2019-02-19

    申请号:US16146924

    申请日:2018-09-28

    申请人: Apprente, Inc.

    摘要: In one embodiment synthetic training data items are generated, each comprising a) a textual representation of a synthetic sentence and b) one or more transcodes of the synthetic sentence comprising one or more actions and one or more entities associated with the one or more actions. For each synthetic training data item, the textual representation of the synthetic sentence is converted into a sequence of phonemes that represent the synthetic sentence. A first machine learning model is then trained as a transcoder that determines transcodes comprising actions and associated entities from sequences of phonemes, wherein the training is performed using a first training dataset comprising the plurality of synthetic training data items that comprise a) sequences phonemes that represent synthetic sentences and b) transcodes of the synthetic sentences. The transcoder may be used in a conversational agent.

    Recurrent machine learning system for lifelong learning

    公开(公告)号:US10325223B1

    公开(公告)日:2019-06-18

    申请号:US15890196

    申请日:2018-02-06

    申请人: Apprente, Inc.

    IPC分类号: G06N5/02 G06N20/00

    摘要: Some embodiments described herein cover a machine learning architecture with a separated perception subsystem and application subsystem. These subsystems can be co-trained to yield a lifelong learning system that can capture spatio-temporal regularities in its inputs. In one example embodiment a first node of the machine learning architecture receives a data item. The first node receives a first feature vector that was generated at a first time. The first node processes information from at least a portion of the data item and at least a portion of the first feature vector at a second time to generate a second feature vector. The first node generates a sparse feature vector from the second feature vector, wherein a majority of feature elements in the sparse feature vector have a value of zero. A second node of the machine learning architecture then processes the sparse feature vector to determine a first output.