公开(公告)号：US11790185B2

公开(公告)日：2023-10-17

申请号：US17043433

申请日：2019-03-28

Applicant: NTT DOCOMO, INC.

Inventor： Hosei Matsuoka

IPC: G06F40/51 ,  G06F40/263 ,  G06N3/049

CPC classification number: G06F40/51 ,  G06F40/263 ,  G06N3/049

Abstract: A created sentence evaluating device 1 using a neural network unit 10 of an encoder/decoder model in which an encoder unit 100 inputs a sentence in a first language, and a decoder unit 101 sequentially outputs word candidates for a sentence in a second language corresponding to the sentence in the first language and likelihood of the word candidates includes: an encoder input unit 13 configured to input a created sentence created in the second language to the encoder unit 100 sequentially for each word; and an evaluation unit 17 configured to evaluate words of the created sentence on the basis of word candidates in the second language and the likelihood of the word candidates output by the decoder unit 101 on the basis of an input from the encoder input unit 13.

公开(公告)号：US20230316052A1

公开(公告)日：2023-10-05

申请号：US18034287

申请日：2020-11-27

Applicant: PEKING UNIVERSITY

Inventor： Ru HUANG ,  Jin LUO ,  Tianyi LIU ,  Qianqian HUANG

IPC: G06N3/049

CPC classification number: G06N3/049

Abstract: Disclosed is a method for implementing an adaptive stochastic spiking neuron based on a ferroelectric field effect transistor, relating to the technical field of spiking neurons in neuromorphic computing. Hardware in the method includes a ferroelectric field effect transistor (fefet), an n-type mosfet, and an I-fefet formed by enhancing a polarization degradation characteristic of a ferroelectric material for the ferroelectric field-effect transistor, wherein a series structure of the fefet and the n-type mosfet adaptively modulates a voltage pulse signal transmitted from a synapse. The I-fefet has a gate terminal connected to a source terminal of the fefet to receive the modulated pulse signal, and simulates integration, leakage, and stochastic spike firing characteristics of a biological neuron, thereby implementing an advanced function of adaptive stochastic spike firing of the neuron.

公开(公告)号：US11775816B2

公开(公告)日：2023-10-03

申请号：US16538078

申请日：2019-08-12

Applicant: Micron Technology, Inc.

Inventor： Robert Richard Noel Bielby ,  Poorna Kale

IPC: G06F12/00 ,  G06N3/08 ,  G06N5/04 ,  G06N3/049 ,  G06F3/06 ,  G06F12/02

CPC classification number: G06N3/08 ,  G06F3/0605 ,  G06F3/0656 ,  G06F3/0679 ,  G06F12/0238 ,  G06N3/049 ,  G06N5/04 ,  G06F2212/251

Abstract: Systems, methods and apparatus of optimizing neural network computations of predictive maintenance of vehicles. For example, a data storage device of a vehicle includes: a host interface configured to receive a sensor data stream from at least one sensor configured on the vehicle; at least one storage media component having a non-volatile memory; and a controller. The non-volatile memory is configured into multiple partitions (e.g., namespaces) having different sets of memory operation settings configured for different types of data related to an artificial neural network (ANN). The partitions include an output partition configured to store output data from the ANN. The sensor data stream is applied in the ANN to predict a maintenance service of the vehicle. The memory units of the input partition can be configured for cyclic sequential overwrite of selected outputs that are updated less frequently than inputs to the ANN.

公开(公告)号：US11769040B2

公开(公告)日：2023-09-26

申请号：US16517431

申请日：2019-07-19

Applicant: NVIDIA Corp.

Inventor： Yakun Shao ,  Rangharajan Venkatesan ,  Nan Jiang ,  Brian Matthew Zimmer ,  Jason Clemons ,  Nathaniel Pinckney ,  Matthew R Fojtik ,  William James Dally ,  Joel S. Emer ,  Stephen W. Keckler ,  Brucek Khailany

IPC: G06F7/02 ,  G06N3/049 ,  G06F9/445 ,  G06F9/54 ,  G06N3/082

CPC classification number: G06N3/049 ,  G06F9/44505 ,  G06F9/544 ,  G06N3/082

Abstract: A distributed deep neural net (DNN) utilizing a distributed, tile-based architecture implemented on a semiconductor package. The package includes multiple chips, each with a central processing element, a global memory buffer, and processing elements. Each processing element includes a weight buffer, an activation buffer, and multiply-accumulate units to combine, in parallel, the weight values and the activation values.

公开(公告)号：US11749259B2

公开(公告)日：2023-09-05

申请号：US17150491

申请日：2021-01-15

Applicant: Google LLC

Inventor： Charles Caleb Peyser ,  Tara N. Sainath ,  Golan Pundak

IPC: G10L15/06 ,  G10L15/16 ,  G10L15/18 ,  G10L15/187 ,  G06N3/049

CPC classification number: G10L15/063 ,  G06N3/049 ,  G10L15/16 ,  G10L15/187 ,  G10L15/1815

Abstract: A method for training a speech recognition model with a minimum word error rate loss function includes receiving a training example comprising a proper noun and generating a plurality of hypotheses corresponding to the training example. Each hypothesis of the plurality of hypotheses represents the proper noun and includes a corresponding probability that indicates a likelihood that the hypothesis represents the proper noun. The method also includes determining that the corresponding probability associated with one of the plurality of hypotheses satisfies a penalty criteria. The penalty criteria indicating that the corresponding probability satisfies a probability threshold, and the associated hypothesis incorrectly represents the proper noun. The method also includes applying a penalty to the minimum word error rate loss function.

公开(公告)号：US11745902B1

公开(公告)日：2023-09-05

申请号：US16710172

申请日：2019-12-11

Applicant: Government of the United States of America as represented by the Secretary of the Air Force

Inventor： Jason Guarnieri ,  John Thurman ,  Jeremy Wojcik

IPC: B64G1/56 ,  B64G1/68 ,  B64G1/24 ,  B64G1/28 ,  B64G1/10 ,  G06N3/04 ,  B64G1/00 ,  G06N3/049

CPC classification number: B64G1/56 ,  B64G1/10 ,  B64G1/242 ,  B64G1/28 ,  B64G1/68 ,  G06N3/049 ,  B64G1/002

Abstract: Systems, methods and apparatus related to a self-preservation/self-protection system (SPS). The SPS system includes a local area situation awareness sensor suite (LASASS), multiple central pattern generator (mCPG) decision circuitries and related actuators. The SPS system utilizes the LASASS, mCPG circuitries and actuators to perform the desired processing and effectuate changes in the position of an object to be detected or avoided.

公开(公告)号：US11742087B2

公开(公告)日：2023-08-29

申请号：US16990172

申请日：2020-08-11

Applicant: Google LLC

Inventor： Jonas Beachey Kemp ,  Andrew M. Dai ,  Alvin Rishi Rajkomar

IPC: G16H50/20 ,  G06N3/049 ,  G16H10/60 ,  G16H50/30

CPC classification number: G16H50/20 ,  G06N3/049 ,  G16H10/60 ,  G16H50/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting future patient health using neural networks. One of the methods includes receiving electronic health record data for a patient; generating a respective observation embedding for each of the observations, comprising, for each clinical note: processing the sequence of tokens in the clinical note using a clinical note embedding LSTM to generate a respective token embedding for each of the tokens; and generating the observation embedding for the clinical note from the token embeddings; generating an embedded representation, comprising, for each time window: combining the observation embeddings of observations occurring during the time window to generate a patient record embedding; and processing the embedded representation of the electronic health record data using a prediction recurrent neural network to generate a neural network output that characterizes a future health status of the patient.

公开(公告)号：US11741555B2

公开(公告)日：2023-08-29

申请号：US17777053

申请日：2020-10-29

Applicant: ZHEJIANG UNIVERSITY

Inventor： Tao Lin ,  Renhai Zhong ,  Jinfan Xu ,  Hao Jiang ,  Yibin Ying ,  Kuan-Chong Ting

IPC: G06Q50/02 ,  G01W1/02 ,  G06N3/049 ,  G06N3/084 ,  G06Q10/04 ,  G06N3/045

CPC classification number: G06Q50/02 ,  G01W1/02 ,  G06N3/045 ,  G06N3/049 ,  G06N3/084 ,  G06Q10/04

Abstract: A crop yield estimation method based on spatio-temporal deep learning including: obtaining regional historical crop yield data and meteorological data, preprocessing the meteorological data and the yield data to respectively obtain meteorological parameters and a detrended yield as input and output of the crop yield spatio-temporal deep learning model; constructing the spatio-temporal deep learning model for crop yield estimation, and optimizing hyperparameters; and building a training set by taking the meteorological parameters as an input and the detrended yield as output to train the model and obtain parameters of the model; for the crop yield to be estimated, feeding meteorological parameters into the trained model, and obtaining the crop yield estimation result. The model combined temporal and spatial learning to achieve better crop yield estimation accuracy and stability at large spatial scales.

公开(公告)号：US11741511B2

公开(公告)日：2023-08-29

申请号：US16779781

申请日：2020-02-03

Applicant: Intuit Inc.

Inventor： Erez Katzenelson ,  Elik Sror ,  Shlomi Medalion ,  Shimon Shahar ,  Shir Meir Lador ,  Sigalit Bechler ,  Alexander Zhicharevich ,  Onn Bar

IPC: G06Q30/04 ,  G06N3/049 ,  G06Q10/067 ,  G06F40/268 ,  G06F40/216

CPC classification number: G06Q30/04 ,  G06F40/216 ,  G06F40/268 ,  G06N3/049 ,  G06Q10/067

Abstract: In one aspect, the present disclosure relates to a method of generating business descriptions performed by a server, said method may include: receiving a plurality of invoices, each invoice being associated with a business of a plurality of businesses; extracting a plurality of texts from the plurality of invoices; embedding the plurality of texts to a vector space to obtain a plurality of invoice vectors; generating a plurality of clusters in the vector space, each cluster of the plurality of clusters comprising at least one invoice vector of the plurality of invoice vectors; generating a description for a cluster, the description for the cluster representing all invoice vectors assigned to the cluster; for each business of the plurality of businesses that has at least one invoice vector assigned to the cluster, associating the business with the description; and indexing the plurality of businesses within a database by the generated descriptions.

公开(公告)号：US11734519B2

公开(公告)日：2023-08-22

申请号：US17172871

申请日：2021-02-10

Applicant: Clinc, Inc.

Inventor： Andrew Lee ,  Zhenguo Chen ,  Jonathan K. Kummerfeld

IPC: G06F40/00 ,  G06F40/35 ,  G06N3/049 ,  G06N20/00

CPC classification number: G06F40/35 ,  G06N3/049 ,  G06N20/00

Abstract: A system and method for implementing slot-relation extraction for a task-oriented dialogue system that includes implementing dialogue intent classification machine learning models that predict a category of dialogue of a single utterance based on an input of utterance data relating to the single utterance, wherein the category of dialogue informs a selection of slot-filling machine learning models; implementing the slot-filling machine learning models that predict slot classification labels for each of a plurality of slots within the utterance based on the input of the utterance data; implementing a slot relation extraction machine learning model that predicts semantic relationship classifications between two or more distinct slots of tokens of the utterance; and generating a response to the single utterance or performing actions in response to the single utterance based on the semantic relationship classifications between the distinct pairings of the two or more distinct slots of the single utterance.