-
公开(公告)号:US20240339200A1
公开(公告)日:2024-10-10
申请号:US18627831
申请日:2024-04-05
发明人: DongAo Ma , Jiaxuan Pang , Jianming Liang
IPC分类号: G16H30/40 , G06V10/764 , G16H30/20
CPC分类号: G16H30/40 , G06V10/764 , G16H30/20
摘要: Exemplary systems include means for receiving medical image data at the system from a plurality of datasets provided via publicly available sources; evaluating the medical image data for the presence of expert notation embedded within the medical image data; determining the expert notations embedded within the medical image data are formatted using inconsistent and heterogeneous labeling across the plurality of datasets; generating an interim AI model by applying a task head classifier to learn the annotations of the expert notations embedded within the medical image data to generate an interim AI model; scaling the interim AI model having the learned annotations of the expert notations embedded therein to additional tasks by applying multi-task heads using cyclical pre-training of the interim AI model trained previously to generate task-specific AI models, with each respective task-specific AI model having differently configured task-specific learning objectives; training a pre-trained AI model specially configured for an application-specific target task by applying task re-visitation training forcing the pre-trained AI model being trained to re-visit all tasks in each round of training and forcing the pre-trained AI model being trained to re-use all accrued knowledge to improve learning by the pre-trained AI model being trained against the current application-specific target task for which the pre-trained AI model is being trained.
-
公开(公告)号:US11922628B2
公开(公告)日:2024-03-05
申请号:US17224886
申请日:2021-04-07
发明人: Zongwei Zhou , Vatsal Sodha , Jiaxuan Pang , Jianming Liang
IPC分类号: G06V10/00 , G06F18/21 , G06F18/214 , G06N3/045 , G06N3/088 , G06T3/00 , G06T7/11 , G06V10/26 , G06V10/77 , G16H30/40
CPC分类号: G06T7/11 , G06F18/2155 , G06F18/2163 , G06N3/045 , G06N3/088 , G06T3/00 , G06V10/26 , G06V10/7715 , G16H30/40 , G06V2201/03
摘要: Described herein are means for generation of self-taught generic models, named Models Genesis, without requiring any manual labeling, in which the Models Genesis are then utilized for the processing of medical imaging. For instance, an exemplary system is specially configured for learning general-purpose image representations by recovering original sub-volumes of 3D input images from transformed 3D images. Such a system operates by cropping a sub-volume from each 3D input image; performing image transformations upon each of the sub-volumes cropped from the 3D input images to generate transformed sub-volumes; and training an encoder-decoder architecture with skip connections to learn a common image representation by restoring the original sub-volumes cropped from the 3D input images from the transformed sub-volumes generated via the image transformations. A pre-trained 3D generic model is thus provided, based on the trained encoder-decoder architecture having learned the common image representation which is capable of identifying anatomical patterns in never before seen 3D medical images having no labeling and no annotation. More importantly, the pre-trained generic models lead to improved performance in multiple target tasks, effective across diseases, organs, datasets, and modalities.
-
公开(公告)号:US20230306723A1
公开(公告)日:2023-09-28
申请号:US18126318
申请日:2023-03-24
发明人: DongAo Ma , Jiaxuan Pang , Nahid Ul Islam , Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Jianming Liang
IPC分类号: G06T7/00 , G06V10/776 , G06V10/774 , G06V10/764 , G06N3/0895
CPC分类号: G06V10/774 , G06N3/0895 , G06T7/0012 , G06V10/764 , G06V10/776 , G06T2207/10116 , G06T2207/20081 , G06T2207/20092 , G06T2207/30004 , G06V2201/03
摘要: Described herein are systems, methods, and apparatuses for implementing self-supervised domain-adaptive pre-training via a transformer for use with medical image classification in the context of medical image analysis. An exemplary system includes means for receiving a first set of training data having non-medical photographic images; receiving a second set of training data with medical images; pre-training an AI model on the first set of training data with the non-medical photographic images; performing domain-adaptive pre-training of the AI model via self-supervised learning operations using the second set of training data having the medical images; generating a trained domain-adapted AI model by fine-tuning the AI model against the targeted medical diagnosis task using the second set of training data having the medical images; outputting the trained domain-adapted AI model; and executing the trained domain-adapted AI model to generate a predicted medical diagnosis from an input image not present within the training data.
-
公开(公告)号:US20230306562A1
公开(公告)日:2023-09-28
申请号:US18126317
申请日:2023-03-24
发明人: Jiaxuan Pang , DongAo Ma , Jiangming Liang
CPC分类号: G06T5/005 , G06T7/0012 , G06T5/10 , G16H30/40 , G16H50/20 , G06T2207/30004 , G06T2207/20081 , G06T2207/20048 , G06T2207/20032 , G06T2207/20192 , G06T2207/20084 , G06T2207/20021 , G06T2207/20092
摘要: Described herein are means for performing self-supervised visual representation learning using order and appearance recovery on a vision transformer. An exemplary system having a processor and memory is specially configured to execute instructions including: receiving medical image training data; selecting a medical image; generating a first perturbed image by applying local pixel shuffling and other image perturbations and outputting a first patchified perturbed image; generating a second randomized patchified image by patchifying and applying a random permutation to the original image; inputting the first patchified perturbed image and the second randomized patchified image into first and second transformer encoders which each generate and then share first and second generated weights through the recovery of both and patch order appearance from each image; and outputting a pre-trained AI model to perform medical image diagnosis on a new medical image absent from the training data input received by the system.
-
公开(公告)号:US20210326653A1
公开(公告)日:2021-10-21
申请号:US17224886
申请日:2021-04-07
发明人: Zongwei Zhou , Vatsal Sodha , Jiaxuan Pang , Jianming Liang
摘要: Described herein are means for generation of self-taught generic models, named Models Genesis, without requiring any manual labeling, in which the Models Genesis are then utilized for the processing of medical imaging. For instance, an exemplary system is specially configured for learning general-purpose image representations by recovering original sub-volumes of 3D input images from transformed 3D images. Such a system operates by cropping a sub-volume from each 3D input image; performing image transformations upon each of the sub-volumes cropped from the 3D input images to generate transformed sub-volumes; and training an encoder-decoder architecture with skip connections to learn a common image representation by restoring the original sub-volumes cropped from the 3D input images from the transformed sub-volumes generated via the image transformations. A pre-trained 3D generic model is thus provided, based on the trained encoder-decoder architecture having learned the common image representation which is capable of identifying anatomical patterns in never before seen 3D medical images having no labeling and no annotation. More importantly, the pre-trained generic models lead to improved performance in multiple target tasks, effective across diseases, organs, datasets, and modalities.
-
-
-
-