公开(公告)号：US20230306562A1

公开(公告)日：2023-09-28

申请号：US18126317

申请日：2023-03-24

申请人： Arizona Board of Regents on behalf of Arizona State University

发明人： Jiaxuan Pang ,  DongAo Ma ,  Jiangming Liang

IPC分类号： G06T5/00 ,  G06T7/00 ,  G06T5/10 ,  G16H30/40 ,  G16H50/20

CPC分类号： G06T5/005 ,  G06T7/0012 ,  G06T5/10 ,  G16H30/40 ,  G16H50/20 ,  G06T2207/30004 ,  G06T2207/20081 ,  G06T2207/20048 ,  G06T2207/20032 ,  G06T2207/20192 ,  G06T2207/20084 ,  G06T2207/20021 ,  G06T2207/20092

摘要： Described herein are means for performing self-supervised visual representation learning using order and appearance recovery on a vision transformer. An exemplary system having a processor and memory is specially configured to execute instructions including: receiving medical image training data; selecting a medical image; generating a first perturbed image by applying local pixel shuffling and other image perturbations and outputting a first patchified perturbed image; generating a second randomized patchified image by patchifying and applying a random permutation to the original image; inputting the first patchified perturbed image and the second randomized patchified image into first and second transformer encoders which each generate and then share first and second generated weights through the recovery of both and patch order appearance from each image; and outputting a pre-trained AI model to perform medical image diagnosis on a new medical image absent from the training data input received by the system.