SECOND-ORDER OPTIMIZATION METHODS FOR AVOIDING SADDLE POINTS DURING THE TRAINING OF DEEP NEURAL NETWORKS

    公开(公告)号:US20210357740A1

    公开(公告)日:2021-11-18

    申请号:US16337154

    申请日:2018-04-12

    Abstract: A computer-implemented method for training a deep neural network includes defining a loss function corresponding to the deep neural network, receiving a training dataset comprising training samples, and setting current parameter values to initial parameter values. An optimization method is performed which iteratively minimizes the loss function. During each iteration, a steepest direction of the loss function is calculated by determining the gradient of the loss function at the current parameter values. A batch of samples included in training samples is selected. A matrix-free CG solver is applied to obtain an inexact solution to a linear system defined by the steepest direction of the loss function and a stochastic Hessian matrix with respect to the batch of samples. A descent direction is determined, and the parameter values are updated based on the descent direction. Following the optimization method, the parameter values are stored in relationship to the deep neural network.

    Methods and Systems for Performance Loss Estimation of Single Input Systems

    公开(公告)号:US20210324835A1

    公开(公告)日:2021-10-21

    申请号:US17270468

    申请日:2018-08-31

    Abstract: A method for identifying underperforming agents in a multi-agent cooperative system includes receiving information relating to the performance of each agent in the multi-agent system, calculating an estimated extracted resource value of each agent based on the received information, comparing the estimated extracted resource value of each agent to a threshold value, calculating a performance index based on the comparison and identifying an agent as an under-performing agent based on the performance index. A system for identifying under-performing agents in a plurality of agents in a multi-agent cooperative system includes a performance analyzing processor, a communications port for receiving state information for each agent and control information for each agent, a classifier for identifying a subset of agents in the plurality of agents that are performance comparable and an optimizer configured to identify an under-performing agent of performance comparable agents and generate updated control information for the identified under-performing agent.

    SYSTEM AND METHOD FOR AUTOMATED MICROSTRUCTURE ANALYSIS

    公开(公告)号:US20210279853A1

    公开(公告)日:2021-09-09

    申请号:US16810129

    申请日:2020-03-05

    Abstract: A computer-implemented method for assessing material microstructure of a machine component involves obtaining a raw image of a section of the component captured via a microscope. The method further includes pre-processing the raw image to generate a ternary image defined by pixel data including three levels of intensities. The method further includes identifying, from the ternary image, phase boundaries delineating at a phase in a primary constituent material of the component. The method further includes determining a volume associated with the phase based on the identified phase boundaries. The proposed method may be utilized, for example, as an automated tool for assessing material degradation and for quality control of gas turbine engine components.

    ANOMALY LOCALIZATION DENOISING AUTOENCODER FOR MACHINE CONDITION MONITORING

    公开(公告)号:US20210182296A1

    公开(公告)日:2021-06-17

    申请号:US17268619

    申请日:2018-08-24

    Abstract: Systems, techniques, and computer-program products that, individually and in combination, permit machine condition monitoring are provided. In some aspects, state estimation and anomaly localization can be determined jointly. To that end, in some embodiments, systems can be configured using at least a synthetic training dataset. The synthetic training dataset includes sensor output data that incorporates synthetic a random amount of noise to each one of multiple sensor devices that probe an industrial machine. The training dataset also includes synthetic information indicative of location of anomalous sensor device(s) of the multiple sensor devices. Therefore, the systems can learn to determine state estimation and anomalous localization concurrently, in a single operation. Accordingly, the training of the systems is consistent with the operation of the systems during machine condition monitoring. Embodiments of the disclosure provide superior predictive performance over conventional machine condition monitoring approaches.

    A UNIFYING SEMI-SUPERVISED APPROACH FOR MACHINE CONDITION MONITORING AND FAULT DIAGNOSIS

    公开(公告)号:US20210133018A1

    公开(公告)日:2021-05-06

    申请号:US16477253

    申请日:2018-01-22

    Abstract: A computer-implemented method for performing machine condition monitoring for fault diagnosis includes collecting multivariate time series data from a plurality of sensors in a machine and partitioning the multivariate time series data into a plurality of segment clusters. Each segment cluster corresponds to one of a plurality of class labels related to machine condition monitoring. Next, the segment clusters are clustered into segment cluster prototypes. The segment clusters and the segment cluster prototypes are used to learn a discriminative model that predicts a class label. Then, as new multivariate time series data is collected from the sensors in the machine, the discriminative model may be used to predict a new class label corresponding to segments included in the new multivariate time series data. If the new class label indicates a potential fault in operation of the machine, a notification may be provided to one or more users.

    ADDITIVE MANUFACTURED HEAT EXCHANGER
    27.
    发明申请

    公开(公告)号:US20200080796A1

    公开(公告)日:2020-03-12

    申请号:US16516467

    申请日:2019-07-19

    Abstract: 3D printed thermal management devices and corresponding methods of manufacturing are described herein. A thermal management device includes a single contiguous component. The single contiguous component includes a body, a plurality of first fins extending away from the body and a plurality of second fins extending away from the body. A surface area of each first fin of the plurality of first fins is different than a surface area of each second fin of the plurality of second fins. A fin density of the plurality of first fins is different than a fin density of the plurality of second fins.

    Dimensionality reduction in Bayesian Optimization using Stacked Autoencoders

    公开(公告)号:US20190034802A1

    公开(公告)日:2019-01-31

    申请号:US15662917

    申请日:2017-07-28

    Abstract: The present embodiments relate to reducing the input dimensions to a machine-based Bayesian Optimization using stacked autoencoders. By way of introduction, the present embodiments described below include apparatuses and methods for pre-processing a digital input to a machine-based Bayesian Optimization to a lower the dimensional space of the input, thereby lowering the bounds of the Bayesian optimization. The output of the Bayesian Optimization is then projected back into the original dimensional space to determine input and output values in the original dimensional apace. As such, the optimization is performed by the machine in a lower dimension using the stacked autoencoder to constrain the input dimensions to the optimization.

Patent Agency Ranking