公开(公告)号：US20250028965A1

公开(公告)日：2025-01-23

申请号：US18904364

申请日：2024-10-02

Applicant: Intel Corporation

Inventor： Alexander Kozlov ,  Andrey Anufriev ,  Nikolay Lyalyushkin ,  Dmitry Gorokhov ,  Yury Gorbachev

IPC: G06N3/082

Abstract: Systems, apparatuses and methods may provide for technology that selects a subset of linear layers from a plurality of linear layers in a pre-trained artificial intelligence (AI) model, wherein a quantization error of the subset of linear layers exceeds an error threshold. For each linear layer in the subset of linear layers, the technology solves a singular value decomposition (SVD) approximation, generates a first adapter layer and a second adapter layer based on the SVD decomposition, wherein the first adapter layer and the second adapter layer include weight matrices having a first dimension that is less than a first rank threshold and a second dimension that is greater than a second rank threshold, and determines an inference output based on the linear layer, the first adapter layer and the second adapter layer.