SYSTEMS, METHODS, AND APPARATUSES FOR IMPLEMENTING IMPROVED SELF-SUPERVISED LEARNING TECHNIQUES THROUGH RELATING-BASED LEARNING USING TRANSFORMERS

    公开(公告)号:US20240412367A1

    公开(公告)日:2024-12-12

    申请号:US18674642

    申请日:2024-05-24

    Inventor: Jianming Liang

    Abstract: A system implements self-supervised learning through contrastive learning using an image transformer. The transformer receives medical images for training an Artificial Intelligence (AI) model, and executes a first cropping and prediction operation by (i) cropping a first patch P from a first random location L from an image A selected from the plurality of medical images and (ii) training a classification head to predict that the first patch P is part of the image A. The transformer executes a second cropping and prediction operation by (iii) cropping a second patch P from a second random location L from the image A selected from the plurality of medical images and (iv) training the classification head to predict that the second patch P forms no part of an image B selected from the plurality of medical images. The transformer issues a determination that the image B is different than the image A.

Patent Agency Ranking