中科微点-全球专利检索

  1. Login
  2. Sign Up

Search Results

7 records (took 0.014 seconds)

    Self-supervised federated learning
    4.
    发明授权
    Self-supervised federated learning 有权

    公开(公告)号：US12039998B1

    公开(公告)日：2024-07-16

    申请号：US17665129

    申请日：2022-02-04

    Applicant: Amazon Technologies, Inc.

    Inventor： Chieh-Chi Kao ,  Qingming Tang ,  Ming Sun ,  Viktor Rozgic ,  Spyridon Matsoukas ,  Chao Wang

    IPC: G10L25/78 ,  G06N3/045 ,  G06N3/08 ,  G10L25/21

    CPC classification number: G10L25/78 ,  G06N3/045 ,  G06N3/08 ,  G10L25/21

    Abstract: An acoustic event detection system may employ self-supervised federated learning to update encoder and/or classifier machine learning models. In an example operation, an encoder may be pre-trained to extract audio feature data from an audio signal. A decoder may be pre-trained to predict a subsequent portion of audio data (e.g., a subsequent frame of audio data represented by log filterbank energies). The encoder and decoder may be trained using self-supervised learning to improve the decoder's predictions and, by extension, the quality of the audio feature data generated by the encoder. The system may apply federated learning to share encoder updates across user devices. The system may fine-tune the classifier to improve inferences based on the improved audio feature data. The system may distribute classifier updates to the user device(s) to update the on-device classifier.

    Streaming self-attention in a neural network
    5.
    发明授权
    Streaming self-attention in a neural network 有权

    公开(公告)号：US11961514B1

    公开(公告)日：2024-04-16

    申请号：US17547610

    申请日：2021-12-10

    Applicant: Amazon Technologies, Inc.

    Inventor： Chia-Jung Chang ,  Qingming Tang ,  Ming Sun ,  Chao Wang

    IPC: G10L15/16 ,  G10L15/14 ,  G10L17/16

    CPC classification number: G10L15/16

    Abstract: An acoustic event detection system may employ one or more recurrent neural networks (RNNs) to extract features from audio data, and use the extracted features to determine the presence of an acoustic event. The system may use self-attention to emphasize features extracted from portions of audio data that may include features more useful for detecting acoustic events. The system may perform self-attention in an iterative manner to reduce the amount of memory used to store hidden states of the RNN while processing successive portions of the audio data. The system may process the portions of the audio data using the RNN to generate a hidden state for each portion. The system may calculate an interim embedding for each hidden state. An interim embedding calculated for the last hidden state may be normalized to determine a final embedding representing features extracted from the input data by the RNN.

    Media presence detection
    7.
    发明授权
    Media presence detection 有权

    公开(公告)号：US11069352B1

    公开(公告)日：2021-07-20

    申请号：US16278440

    申请日：2019-02-18

    Applicant: Amazon Technologies, Inc.

    Inventor： Qingming Tang ,  Ming Sun ,  Chieh-Chi Kao ,  Chao Wang ,  Viktor Rozgic

    IPC: G10L15/22 ,  G10L25/78 ,  G10L15/16 ,  G10L15/02

    Abstract: Described herein is a system for media presence detection in audio. The system analyzes audio data to recognize whether a given audio segment contains sounds from a media source as a way of differentiating recorded media source sounds from other live sounds. In exemplary embodiments, the system includes a hierarchical model architecture for processing audio data segments, where individual audio data segments are processed by a trained machine learning model operating locally, and another trained machine learning model provides historical and contextual information to determine a score indicating the likelihood that the audio data segment contains sounds from a media source.

Patent Agency Ranking