中科微点-全球专利检索

  1. Login
  2. Sign Up

Search Results

45 records (took 0.02 seconds)

    TRANSFORMER-BASED ENCODING INCORPORATING METADATA
    2.
    发明申请
    TRANSFORMER-BASED ENCODING INCORPORATING METADATA 有权

    公开(公告)号：US20220358288A1

    公开(公告)日：2022-11-10

    申请号：US17308575

    申请日：2021-05-05

    Applicant: International Business Machines Corporation

    Inventor： Hui Wan ,  Xiaodong Cui ,  Luis A. Lastras-Montano

    IPC: G06F40/284 ,  G06F40/205 ,  G06F40/237 ,  G06F40/30 ,  G06F40/42 ,  G06K9/66

    Abstract: From metadata of a corpus of natural language text documents, a relativity matrix is constructed, a row-column intersection in the relativity matrix corresponding to a relationship between two instances of a type of metadata. An encoder model is trained, generating a trained encoder model, to compute an embedding corresponding to a token of a natural language text document within the corpus and the relativity matrix, the encoder model comprising a first encoder layer, the first encoder layer comprising a token embedding portion, a relativity embedding portion, a token self-attention portion, a metadata self-attention portion, and a fusion portion, the training comprising adjusting a set of parameters of the encoder model.

    DYNAMIC NETWORK BANDWIDTH IN DISTRIBUTED DEEP LEARNING TRAINING
    3.
    发明申请
    DYNAMIC NETWORK BANDWIDTH IN DISTRIBUTED DEEP LEARNING TRAINING 有权

    公开(公告)号：US20220012642A1

    公开(公告)日：2022-01-13

    申请号：US16925192

    申请日：2020-07-09

    Applicant: International Business Machines Corporation

    Inventor： Wei Zhang ,  Xiaodong Cui ,  Abdullah Kayi ,  Alper Buyuktosunoglu

    IPC: G06N20/20 ,  H04L12/24 ,  G06N3/02

    Abstract: Embodiments of a method are disclosed. The method includes performing distributed deep learning training on a batch of training data. The method also includes determining training times representing an amount of time between a beginning batch time and an end batch time. Further, the method includes modifying a communication aspect of the communication straggler to reduce a future network communication time for the communication straggler to send a future result of the distributed deep learning training on a new batch of training data in response to the centralized parameter server determining that the learner is the communication straggler.

    CONTEXT-AWARE RELEVANCE MODELING IN CONVERSATIONAL SYSTEMS
    5.
    发明申请
    CONTEXT-AWARE RELEVANCE MODELING IN CONVERSATIONAL SYSTEMS 有权

    公开(公告)号：US20250068635A1

    公开(公告)日：2025-02-27

    申请号：US18453127

    申请日：2023-08-21

    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

    Inventor： Hui Wan ,  Xiaodong Cui ,  Songtao Lu ,  Marina Danilevsky Hailpern

    IPC: G06F16/2457

    Abstract: A method, computer system, and a computer program product are provided for a context-aware relevancy modelling in conversational systems. A user query is received. A latent static content d is selected from a corpus of content D. A latent set of context C from a set of external context Cu is also selected. A result is generated using a scoring function and using the latent static content d from a corpus D and the latent set of context C from the set of external contexts CU so as to provide a most relevant context-base search response to said user query q. The result provides a most relevant context-base search response to said user query q. A response is then generated based on said result using said scoring function result to said user query q.

    LENGTH PERTURBATION TECHNIQUES FOR IMPROVING GENERALIZATION OF DEEP NEURAL NETWORK ACOUSTIC MODELS
    6.
    发明公开
    LENGTH PERTURBATION TECHNIQUES FOR IMPROVING GENERALIZATION OF DEEP NEURAL NETWORK ACOUSTIC MODELS 审中-公开

    公开(公告)号：US20240170005A1

    公开(公告)日：2024-05-23

    申请号：US18057967

    申请日：2022-11-22

    Applicant: International Business Machines Corporation

    Inventor： Xiaodong Cui ,  Brian E. D. Kingsbury ,  George Andrei Saon

    IPC: G10L21/04

    CPC classification number: G10L21/04

    Abstract: One or more systems, devices, computer program products and/or computer-implemented methods of use provided herein relate to length perturbation techniques for improving generalization of DNN acoustic models. A computer-implemented system can comprise a memory that can store computer executable components. The computer-implemented system can further comprise a processor that can execute the computer executable components stored in the memory, wherein the computer executable components can comprise a frame skipping component that can remove one or more frames from an acoustic utterance via frame skipping. The computer executable components can further comprise a frame insertion component that can insert one or more replacement frames into the acoustic utterance via frame insertion to replace the one or more frames with the one or more replacement frames to enable length perturbation of the acoustic utterance.

    EXPLAINING OUTLIERS IN TIME SERIES AND EVALUATING ANOMALY DETECTION METHODS
    10.
    发明申请
    EXPLAINING OUTLIERS IN TIME SERIES AND EVALUATING ANOMALY DETECTION METHODS 有权

    公开(公告)号：US20220253426A1

    公开(公告)日：2022-08-11

    申请号：US17170164

    申请日：2021-02-08

    Applicant: International Business Machines Corporation ,  The Board of Trustees of the University of Illinois

    Inventor： Yada Zhu ,  Jinjun Xiong ,  Jingrui He ,  Lecheng Zheng ,  Xiaodong Cui

    IPC: G06F16/23 ,  G06N3/04 ,  G06N3/08

    Abstract: Time series data can be received. A machine learning model can be trained using the time series data. A contaminating process can be estimated based on the time series data, the contaminating process including outliers associated with the time series data. A parameter associated with the contaminating process can be determined. Based on the trained machine learning model and the parameter associated with the contaminating process, a single-valued metric can be determined, which represents an impact of the contaminating process on the machine learning model's future prediction. A plurality of different outlier detecting machine learning models can be used to estimate the contaminating process and the single-valued metric can be determined for each of the plurality of different outlier detecting machine learning models. The plurality of different outlier detecting machine learning models can be ranked according to the associated single-valued metric.

Patent Agency Ranking