中科微点-全球专利检索

  1. Login
  2. Sign Up

Search Results

26 records (took 0.018 seconds)

    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
    11.
    发明申请
    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS 有权

    公开(公告)号：US20210064924A1

    公开(公告)日：2021-03-04

    申请号：US17098271

    申请日：2020-11-13

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Niki J. Parmar ,  Ashish Teku Vaswani

    IPC: G06K9/62 ,  G06K9/46 ,  G06N3/08 ,  G06N3/04 ,  G06T3/40

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output image. In one aspect, one of the methods includes generating the output image intensity value by intensity value according to a generation order of pixel—color channel pairs from the output image, comprising, for each particular generation order position in the generation order: generating a current output image representation of a current output image, processing the current output image representation using a decoder neural network to generate a probability distribution over possible intensity values for the pixel—color channel pair at the particular generation order position, wherein the decoder neural network includes one or more local masked self-attention sub-layers; and selecting an intensity value for the pixel—color channel pair at the particular generation order position using the probability distribution.

    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
    12.
    发明申请
    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS 审中-公开

    公开(公告)号：US20190130213A1

    公开(公告)日：2019-05-02

    申请号：US16174074

    申请日：2018-10-29

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Niki Parmar ,  Ashish Teku Vaswani

    IPC: G06K9/62 ,  G06K9/46 ,  G06N3/04 ,  G06N3/08

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output image. In one aspect, one of the methods includes generating the output image intensity value by intensity value according to a generation order of pixel-color channel pairs from the output image, comprising, for each particular generation order position in the generation order: generating a current output image representation of a current output image, processing the current output image representation using a decoder neural network to generate a probability distribution over possible intensity values for the pixel-color channel pair at the particular generation order position, wherein the decoder neural network includes one or more local masked self-attention sub-layers; and selecting an intensity value for the pixel-color channel pair at the particular generation order position using the probability distribution.

    ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS
    13.
    发明申请
    ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS 审中-公开

    公开(公告)号：US20180341860A1

    公开(公告)日：2018-11-29

    申请号：US16021971

    申请日：2018-06-28

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Aidan Nicholas Gomez ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Llion Owen Jones ,  Niki J. Parmar ,  Illia Polosukhin ,  Ashish Teku Vaswani

    IPC: G06N3/08 ,  G06N3/04

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output sequence from an input sequence. In one aspect, one of the systems includes an encoder neural network configured to receive the input sequence and generate encoded representations of the network inputs, the encoder neural network comprising a sequence of one or more encoder subnetworks, each encoder subnetwork configured to receive a respective encoder subnetwork input for each of the input positions and to generate a respective subnetwork output for each of the input positions, and each encoder subnetwork comprising: an encoder self-attention sub-layer that is configured to receive the subnetwork input for each of the input positions and, for each particular input position in the input order: apply an attention mechanism over the encoder subnetwork inputs using one or more queries derived from the encoder subnetwork input at the particular input position.

    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
    15.
    发明申请
    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS 有权

    公开(公告)号：US20250118064A1

    公开(公告)日：2025-04-10

    申请号：US18913134

    申请日：2024-10-11

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Niki J. Parmar ,  Ashish Teku Vaswani

    IPC: G06V10/82 ,  G06F18/21 ,  G06F18/213 ,  G06F18/28 ,  G06N3/04 ,  G06N3/084 ,  G06T3/4053 ,  G06V10/56 ,  G06V10/77

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output image. In one aspect, one of the methods includes generating the output image intensity value by intensity value according to a generation order of pixel-color channel pairs from the output image, comprising, for each particular generation order position in the generation order: generating a current output image representation of a current output image, processing the current output image representation using a decoder neural network to generate a probability distribution over possible intensity values for the pixel—color channel pair at the particular generation order position, wherein the decoder neural network includes one or more local masked self-attention sub-layers; and selecting an intensity value for the pixel—color channel pair at the particular generation order position using the probability distribution.

    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
    18.
    发明申请
    ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS 有权

    公开(公告)号：US20230076971A1

    公开(公告)日：2023-03-09

    申请号：US17867242

    申请日：2022-07-18

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Niki J. Parmar ,  Ashish Teku Vaswani

    IPC: G06K9/62 ,  G06N3/08 ,  G06N3/04 ,  G06T3/40 ,  G06V10/56

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output image. In one aspect, one of the methods includes generating the output image intensity value by intensity value according to a generation order of pixel—color channel pairs from the output image, comprising, for each particular generation order position in the generation order: generating a current output image representation of a current output image, processing the current output image representation using a decoder neural network to generate a probability distribution over possible intensity values for the pixel—color channel pair at the particular generation order position, wherein the decoder neural network includes one or more local masked self-attention sub-layers; and selecting an intensity value for the pixel—color channel pair at the particular generation order position using the probability distribution.

    Attention-based sequence transduction neural networks
    19.
    发明授权
    Attention-based sequence transduction neural networks 有权

    公开(公告)号：US11113602B2

    公开(公告)日：2021-09-07

    申请号：US16932422

    申请日：2020-07-17

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Aidan Nicholas Gomez ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Llion Owen Jones ,  Niki J. Parmar ,  Illia Polosukhin ,  Ashish Teku Vaswani

    IPC: G06N3/04 ,  G06N3/08

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output sequence from an input sequence. In one aspect, one of the systems includes an encoder neural network configured to receive the input sequence and generate encoded representations of the network inputs, the encoder neural network comprising a sequence of one or more encoder subnetworks, each encoder subnetwork configured to receive a respective encoder subnetwork input for each of the input positions and to generate a respective subnetwork output for each of the input positions, and each encoder subnetwork comprising: an encoder self-attention sub-layer that is configured to receive the subnetwork input for each of the input positions and, for each particular input position in the input order: apply an attention mechanism over the encoder subnetwork inputs using one or more queries derived from the encoder subnetwork input at the particular input position.

    ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS
    20.
    发明公开
    ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS 审中-公开

    公开(公告)号：US20240144006A1

    公开(公告)日：2024-05-02

    申请号：US18407299

    申请日：2024-01-08

    Applicant: Google LLC

    Inventor： Noam M. Shazeer ,  Aidan Nicholas Gomez ,  Lukasz Mieczyslaw Kaiser ,  Jakob D. Uszkoreit ,  Llion Owen Jones ,  Niki J. Parmar ,  Illia Polosukhin ,  Ashish Teku Vaswani

    IPC: G06N3/08 ,  G06N3/04 ,  G06N3/045 ,  G06N20/00

    CPC classification number: G06N3/08 ,  G06N3/04 ,  G06N3/045 ,  G06N20/00

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output sequence from an input sequence. In one aspect, one of the systems includes an encoder neural network configured to receive the input sequence and generate encoded representations of the network inputs, the encoder neural network comprising a sequence of one or more encoder subnetworks, each encoder subnetwork configured to receive a respective encoder subnetwork input for each of the input positions and to generate a respective subnetwork output for each of the input positions, and each encoder subnetwork comprising: an encoder self-attention sub-layer that is configured to receive the subnetwork input for each of the input positions and, for each particular input position in the input order: apply an attention mechanism over the encoder subnetwork inputs using one or more queries derived from the encoder subnetwork input at the particular input position.

Patent Agency Ranking