公开(公告)号：US12086290B2

公开(公告)日：2024-09-10

申请号：US17406755

申请日：2021-08-19

Applicant: Intel Corporation

Inventor： Yamini Nimmagadda ,  Akhila Vidiyala ,  Suryaprakash Shanmugam

IPC: G06F21/64 ,  G06F8/41 ,  G06N5/04 ,  H04L9/32

CPC classification number: G06F21/64 ,  G06F8/41 ,  G06N5/04 ,  H04L9/3236 ,  H04L9/3247

Abstract: Systems, apparatuses and methods include technology that generates a signature based on one or more characteristics of an artificial intelligence (AI) model. The AI model is in a source code. The technology generates a compiled blob based on the AI model and embeds an identifier based on the signature into a metadata field of the compiled blob.

公开(公告)号：US20210406777A1

公开(公告)日：2021-12-30

申请号：US17470654

申请日：2021-09-09

Applicant: Intel Corporation

Inventor： Suryaprakash Shanmugam ,  Yamini Nimmagadda ,  Akhila Vidiyala

IPC: G06N20/00

Abstract: Systems, apparatuses and methods include technology that identifies compute capacities of edge nodes and memory capacities of the edge nodes. The technology further identifies a first variant of an Artificial Intelligence (AI) model, and assigns the first variant to a first edge node of the edge nodes based on a compute capacity requirement associated with execution of the first variant, a memory resource requirement associated with execution of the first variant, the compute capacities and the memory capacities.

公开(公告)号：US20210382754A1

公开(公告)日：2021-12-09

申请号：US17406711

申请日：2021-08-19

Applicant: Intel Corporation

Inventor： Yamini Nimmagadda ,  Akhila Vidiyala ,  Suryaprakash Shanmugam ,  Divya Prakash

IPC: G06F9/50 ,  G06N3/08

Abstract: Systems, apparatuses and methods include technology that analyzes an input stream and an artificial intelligence (AI) model graph to generate a workload characterization. The workload characterization characterizes one or more of compute resources or memory resources, and the one or more of the compute resources or the memory resources is associated with execution of the AI model graph based on the input stream. The technology partitions the AI model graph into subgraphs based on the workload characterization. The technology selects a plurality of hardware devices to execute the subgraphs.

公开(公告)号：US12106154B2

公开(公告)日：2024-10-01

申请号：US17406711

申请日：2021-08-19

Applicant: Intel Corporation

Inventor： Yamini Nimmagadda ,  Akhila Vidiyala ,  Suryaprakash Shanmugam ,  Divya Prakash

IPC: G06F9/46 ,  G06F9/50 ,  G06N3/08

CPC classification number: G06F9/505 ,  G06F9/5016 ,  G06F9/5072 ,  G06N3/08

Abstract: Systems, apparatuses and methods include technology that analyzes an input stream and an artificial intelligence (AI) model graph to generate a workload characterization. The workload characterization characterizes one or more of compute resources or memory resources, and the one or more of the compute resources or the memory resources is associated with execution of the AI model graph based on the input stream. The technology partitions the AI model graph into subgraphs based on the workload characterization. The technology selects a plurality of hardware devices to execute the subgraphs.

公开(公告)号：US20210390460A1

公开(公告)日：2021-12-16

申请号：US17459141

申请日：2021-08-27

Applicant: Intel Corporation

Inventor： Yamini Nimmagadda ,  Suryaprakash Shanmugam ,  Akhila Vidiyala ,  Divya Prakash

IPC: G06N20/00 ,  G06K9/62 ,  G06F9/50

Abstract: Systems, apparatuses and methods include technology that converts an artificial intelligence (AI) model graph into an intermediate representation. The technology partitions the intermediate representation of the AI model graph into a plurality of subgraphs based on computations associated with the AI model graph, each subgraph being associated with one or more memory resources and one or more of a plurality of hardware devices. The technology determines whether to readjust the plurality of subgraphs based on the memory resources associated with the plurality of subgraphs and memory capacities of the plurality of hardware devices

公开(公告)号：US20210383026A1

公开(公告)日：2021-12-09

申请号：US17406755

申请日：2021-08-19

Applicant: Intel Corporation

Inventor： Yamini Nimmagadda ,  Akhila Vidiyala ,  Suryaprakash Shanmugam

IPC: G06F21/64 ,  G06N5/04 ,  H04L9/32 ,  G06F8/41

Abstract: Systems, apparatuses and methods include technology that generates a signature based on one or more characteristics of an artificial intelligence (AI) model. The AI model is in a source code. The technology generates a compiled blob based on the AI model and embeds an identifier based on the signature into a metadata field of the compiled blob.

公开(公告)号：US20210365804A1

公开(公告)日：2021-11-25

申请号：US17395056

申请日：2021-08-05

Applicant: Intel Corporation

Inventor： Yamini Nimmagadda ,  Akhila Vidiyala ,  Suryaprakash Shanmugam

IPC: G06N5/02

Abstract: Systems, apparatuses and methods may provide for technology that detects a transfer condition with respect to an artificial intelligence (AI) workload that is active on a source edge node, conducts intra-node tuning on a destination edge node in response to the transfer condition, and moves the AI workload to the destination edge node after the intra-node tuning is complete.