-
1.发明公开公开(公告)号：US20240104916A1
公开(公告)日：2024-03-28
申请号：US18519674
申请日：2023-11-27
Applicant: Intel Corporation
Inventor： Haim Barad , Barak Hurwitz , Uzi Sarel , Eran Geva , Eli Kfir , Moshe Island
CPC classification number: G06V10/82 , G06F30/33 , G06N3/04 , G06V10/454 , G06V10/955
Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.
-
公开(公告)号：US11869232B2
公开(公告)日：2024-01-09
申请号：US18151914
申请日：2023-01-09
Applicant: Intel Corporation
Inventor： Haim Barad , Barak Hurwitz , Uzi Sarel , Eran Geva , Eli Kfir , Moshe Island
CPC classification number: G06V10/82 , G06F30/33 , G06N3/04 , G06V10/454 , G06V10/955
Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.
-
公开(公告)号：US20240378511A1
公开(公告)日：2024-11-14
申请号：US18412261
申请日：2024-01-12
Applicant: Intel Corporation
Inventor： Haim Barad
Abstract: Methods, apparatus, systems and articles of manufacture to self-generate a multiple-output ensemble model defense against adversarial attacks are disclosed. An example apparatus includes a model acquirer to acquire the model, an exit point quantity identifier to determine a number of exit points to place in the model, an exit point selector to select exit points to be enabled in the model, and an exit output generator to generate an additional model structure to calculate an output at each respective exit point.
-
4.发明申请公开(公告)号：US20190180168A1
公开(公告)日：2019-06-13
申请号：US16266880
申请日：2019-02-04
Applicant: Intel Corporation
Inventor： Haim Barad , Barak Hurwitz , Uzi Sarel , Eran Geva , Eli Kfir , Moshe Island
Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.
-
Patent Agency Ranking
公开(公告)号：US12211260B2
公开(公告)日：2025-01-28
申请号：US18519674
申请日：2023-11-27
Applicant: Intel Corporation
Inventor： Haim Barad , Barak Hurwitz , Uzi Sarel , Eran Geva , Eli Kfir , Moshe Island
Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.
-
6.发明公开公开(公告)号：US20230215158A1
公开(公告)日：2023-07-06
申请号：US18151914
申请日：2023-01-09
Applicant: Intel Corporation
Inventor： Haim Barad , Barak Hurwitz , Uzi Sarel , Eran Geva , Eli Kfir , Moshe Island
CPC classification number: G06V10/82 , G06N3/04 , G06F30/33 , G06V10/454 , G06V10/955
Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.
-
公开(公告)号：US11544461B2
公开(公告)日：2023-01-03
申请号：US16411763
申请日：2019-05-14
Applicant: Intel Corporation
Inventor： Barak Battach , Amit Bleiweiss , Haim Barad
IPC: G06F40/30 , G06N20/00 , G06F40/284 , G06F40/216
Abstract: The disclosure provides a natural language processing (NLP) model arranged to operate on two lexicons, where one lexicon is a sub-set of the other lexicon. The NLP model can be arranged to generate output based on the sub-set lexicon and exit processing of the NLP model, to potentially save computation cycles.
-
公开(公告)号：US11562200B2
公开(公告)日：2023-01-24
申请号：US16266880
申请日：2019-02-04
Applicant: Intel Corporation
Inventor： Haim Barad , Barak Hurwitz , Uzi Sarel , Eran Geva , Eli Kfir , Moshe Island
Abstract: Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.
-
公开(公告)号：US20190266236A1
公开(公告)日：2019-08-29
申请号：US16411763
申请日：2019-05-14
Applicant: Intel Corporation
Inventor： Barak Battach , Amit Bleiweiss , Haim Barad
IPC: G06F17/27
Abstract: The disclosure provides a natural language processing (NLP) model arranged to operate on two lexicons, where one lexicon is a sub-set of the other lexicon. The NLP model can be arranged to generate output based on the sub-set lexicon and exit processing of the NLP model, to potentially save computation cycles.
-
-
-
-
-
-
-
-
Search Results
9
records
(took 0.014 seconds)
