End-to-end modelling method and system

    公开(公告)号:US11651578B2

    公开(公告)日:2023-05-16

    申请号:US16329368

    申请日:2017-01-11

    CPC classification number: G06N3/08 G06N3/049 G06N99/00 G10L15/06

    Abstract: A method and a system for end-to-end modeling are provided. The method includes: determining a topological structure of a target-based end-to-end model, where the topological structure includes an input layer, an encoding layer, an code enhancement layer, a filtering layer, a decoding layer and an output layer; the code enhancement layer adds information of a target unit to a feature sequence outputted by the encoding layer, the filtering layer filters a feature sequence added with the information of the target unit; collecting multiple pieces of training data; and training parameters of the target-based end-to-end model by using the multiple pieces of the training data.

    System and method for cognitive self-improvement of smart systems and devices without programming

    公开(公告)号:US11640520B2

    公开(公告)日:2023-05-02

    申请号:US17405967

    申请日:2021-08-18

    Abstract: A method for automatically generating a neural network architecture includes: loading a first computer-readable representation of a first neural network architecture including first genes representing parameters of the first neural network architecture; generating a first neural network including neurons in accordance with the first genes; deploying the first neural network in a robotic controller; training the first neural network by supplying inputs to an input processing unit connected to the first neural network and receiving outputs from an output processing unit connected to the first neural network, the training including updating synaptic weights of connections between the neurons based on responses to the inputs supplied to the input processing unit; evaluating a performance of the first neural network architecture; and generating, by the computer system, an updated computer-readable representation of an updated neural network architecture based on the evaluation of the performance the first neural network.

    Action selection using interaction history graphs

    公开(公告)号:US11636347B2

    公开(公告)日:2023-04-25

    申请号:US16749252

    申请日:2020-01-22

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting actions to be performed by an agent interacting with an environment. In one aspect, a method comprises: obtaining a graph of nodes and edges that represents an interaction history of the agent with the environment; generating an encoded representation of the graph representing the interaction history of the agent with the environment; processing an input based on the encoded representation of the graph using an action selection neural network, in accordance with current values of action selection neural network parameters, to generate an action selection output; and selecting an action from a plurality of possible actions to be performed by the agent using the action selection output generated by the action selection neural network.

    Context-based search using spike waves in spiking neural networks

    公开(公告)号:US11636318B2

    公开(公告)日:2023-04-25

    申请号:US16647814

    申请日:2017-12-15

    Abstract: Techniques and mechanisms for servicing a search query using a spiking neural network. In an embodiment, a spiking neural network receives an indication of a first context of the search query, wherein a set of nodes of the spiking neural network each correspond to a respective entry of a repository. One or more nodes of the set of nodes are each excited to provide a respective cyclical response based on the first context, wherein a first cyclical response is by a first node. Due at least in part to a coupling of the excited nodes, a perturbance signal, based on a second context of the search query, results in a change of the first resonance response relative to one or more other resonance responses. In another embodiment, data corresponding to the first node is selected, based on the change, as an at least partial result of the search query.

    BRAIN-LIKE NEURAL NETWORK WITH MEMORY AND INFORMATION ABSTRACTION FUNCTIONS

    公开(公告)号:US20230087722A1

    公开(公告)日:2023-03-23

    申请号:US17991161

    申请日:2022-11-21

    Inventor: Hualong REN

    Abstract: A kind of neural network is provided which has memory and information abstract functions. This kind of brain neural network borrows the working principle of biological brain hippocampus and its surrounding brain regions, including the memory module can form the episodic memory. It allows the intelligent agent to efficiently identify objects and conduct space navigation, reasoning and independent decision making. It can quickly remember the characteristics of each object and carry out abstraction and meta-learning, has strong generalization ability, and can achieve the lifelong learning. It uses the synaptic plasticity process to adjust the weight, avoids partial differential operation, and has lower computational overhead than the traditional deep learning method, providing a basis for the design and application of neuromorphic chip.

    Arithmetic device
    89.
    发明授权

    公开(公告)号:US11593070B2

    公开(公告)日:2023-02-28

    申请号:US16814479

    申请日:2020-03-10

    Abstract: According to one embodiment, an arithmetic device includes an arithmetic circuit. The arithmetic circuit includes a memory part including a plurality of memory regions, and an arithmetic part. One of the memory regions includes a capacitance including a first terminal, and a first electrical circuit electrically connected to the first terminal and configured to output a voltage signal corresponding to a potential of the first terminal.

    Parallel video processing neural networks

    公开(公告)号:US11580736B2

    公开(公告)日:2023-02-14

    申请号:US16954068

    申请日:2019-01-07

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for parallel processing of video frames using neural networks. One of the methods includes receiving a video sequence comprising a respective video frame at each of a plurality of time steps; and processing the video sequence using a video processing neural network to generate a video processing output for the video sequence, wherein the video processing neural network includes a sequence of network components, wherein the network components comprise a plurality of layer blocks each comprising one or more neural network layers, wherein each component is active for a respective subset of the plurality of time steps, and wherein each layer block is configured to, at each time step at which the layer block is active, receive an input generated at a previous time step and to process the input to generate a block output.

Patent Agency Ranking