Generating trained neural networks with increased robustness against adversarial attacks

    公开(公告)号:US11481617B2

    公开(公告)日:2022-10-25

    申请号:US16253561

    申请日:2019-01-22

    Applicant: Adobe Inc.

    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating trained neural network with increased robustness against adversarial attacks by utilizing a dynamic dropout routine and/or a cyclic learning rate routine. For example, the disclosed systems can determine a dynamic dropout probability distribution associated with neurons of a neural network. The disclosed systems can further drop neurons from a neural network based on the dynamic dropout probability distribution to help neurons learn distinguishable features. In addition, the disclosed systems can utilize a cyclic learning rate routine to force copy weights of a copy neural network away from weights of an original neural network without decreasing prediction accuracy to ensure that the decision boundaries learned are different.

    GENERATING VARIED-SCALE VISUALIZATIONS OF MULTI-DIMENSIONAL DATA

    公开(公告)号:US20210349915A1

    公开(公告)日:2021-11-11

    申请号:US17383009

    申请日:2021-07-22

    Applicant: Adobe Inc.

    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that generate and render a varied-scale-topological construct for a multidimensional dataset to visually represent portions of the multidimensional dataset at different topological scales. In certain implementations, for example, the disclosed systems generate and combine (i) an initial topological construct for a multidimensional dataset at one scale and (ii) a local topological construct for a subset of the multidimensional dataset at another scale to form a varied-scale-topological construct. To identify a region from an initial topological construct to vary in scale, the disclosed systems can determine the relative densities of subsets of multidimensional data corresponding to regions of the initial topological construct and select one or more such regions to change in scale.

    Generating varied-scale topological visualizations of multi-dimensional data

    公开(公告)号:US11100127B2

    公开(公告)日:2021-08-24

    申请号:US16368415

    申请日:2019-03-28

    Applicant: Adobe Inc.

    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that generate and render a varied-scale-topological construct for a multidimensional dataset to visually represent portions of the multidimensional dataset at different topological scales. In certain implementations, for example, the disclosed systems generate and combine (i) an initial topological construct for a multidimensional dataset at one scale and (ii) a local topological construct for a subset of the multidimensional dataset at another scale to form a varied-scale-topological construct. To identify a region from an initial topological construct to vary in scale, the disclosed systems can determine the relative densities of subsets of multidimensional data corresponding to regions of the initial topological construct and select one or more such regions to change in scale.

    GENERATING VARIED-SCALE TOPOLOGICAL VISUALIZATIONS OF MULTI-DIMENSIONAL DATA

    公开(公告)号:US20200311100A1

    公开(公告)日:2020-10-01

    申请号:US16368415

    申请日:2019-03-28

    Applicant: Adobe Inc.

    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that generate and render a varied-scale-topological construct for a multidimensional dataset to visually represent portions of the multidimensional dataset at different topological scales. In certain implementations, for example, the disclosed systems generate and combine (i) an initial topological construct for a multidimensional dataset at one scale and (ii) a local topological construct for a subset of the multidimensional dataset at another scale to form a varied-scale-topological construct. To identify a region from an initial topological construct to vary in scale, the disclosed systems can determine the relative densities of subsets of multidimensional data corresponding to regions of the initial topological construct and select one or more such regions to change in scale.

    GENERATING TRAINED NEURAL NETWORKS WITH INCREASED ROBUSTNESS AGAINST ADVERSARIAL ATTACKS

    公开(公告)号:US20200234110A1

    公开(公告)日:2020-07-23

    申请号:US16253561

    申请日:2019-01-22

    Applicant: Adobe Inc.

    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating trained neural network with increased robustness against adversarial attacks by utilizing a dynamic dropout routine and/or a cyclic learning rate routine. For example, the disclosed systems can determine a dynamic dropout probability distribution associated with neurons of a neural network. The disclosed systems can further drop neurons from a neural network based on the dynamic dropout probability distribution to help neurons learn distinguishable features. In addition, the disclosed systems can utilize a cyclic learning rate routine to force copy weights of a copy neural network away from weights of an original neural network without decreasing prediction accuracy to ensure that the decision boundaries learned are different.

Patent Agency Ranking