中科微点-全球专利检索

  1. Login
  2. Sign Up

Search Results

6 records (took 0.01 seconds)

    DEEP LEARNING INFERENCE EFFICIENCY TECHNOLOGY WITH EARLY EXIT AND SPECULATIVE EXECUTION
    3.
    发明申请
    DEEP LEARNING INFERENCE EFFICIENCY TECHNOLOGY WITH EARLY EXIT AND SPECULATIVE EXECUTION 审中-公开

    公开(公告)号：US20190180168A1

    公开(公告)日：2019-06-13

    申请号：US16266880

    申请日：2019-02-04

    Applicant: Intel Corporation

    Inventor： Haim Barad ,  Barak Hurwitz ,  Uzi Sarel ,  Eran Geva ,  Eli Kfir ,  Moshe Island

    IPC: G06N3/04 ,  G06F9/30 ,  G06F17/50

    Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.

    Deep learning inference efficiency technology with early exit and speculative execution
    4.
    发明授权
    Deep learning inference efficiency technology with early exit and speculative execution 有权

    公开(公告)号：US11562200B2

    公开(公告)日：2023-01-24

    申请号：US16266880

    申请日：2019-02-04

    Applicant: Intel Corporation

    Inventor： Haim Barad ,  Barak Hurwitz ,  Uzi Sarel ,  Eran Geva ,  Eli Kfir ,  Moshe Island

    IPC: G06N3/04 ,  G06F30/33

    Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.

    Deep learning inference efficiency technology with early exit and speculative execution
    5.
    发明授权
    Deep learning inference efficiency technology with early exit and speculative execution 有权

    公开(公告)号：US12211260B2

    公开(公告)日：2025-01-28

    申请号：US18519674

    申请日：2023-11-27

    Applicant: Intel Corporation

    Inventor： Haim Barad ,  Barak Hurwitz ,  Uzi Sarel ,  Eran Geva ,  Eli Kfir ,  Moshe Island

    IPC: G06V10/82 ,  G06F30/33 ,  G06N3/04 ,  G06V10/44 ,  G06V10/94

    Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.

Patent Agency Ranking