Invention Application
- Patent Title: BACKBONE NETWORK LEARNING METHOD AND SYSTEM BASED ON SELF-SUPERVISED LEARNING AND MULTI-HEAD FOR VISUAL INTELLIGENCE
-
Application No.: US18225304Application Date: 2023-07-24
-
Publication No.: US20240394546A1Publication Date: 2024-11-28
- Inventor: Choong Sang CHO , Young Han LEE , Ju Hong YOON , Gui Sik KIM
- Applicant: Korea Electronics Technology Institute
- Applicant Address: KR Seongnam-si
- Assignee: Korea Electronics Technology Institute
- Current Assignee: Korea Electronics Technology Institute
- Current Assignee Address: KR Seongnam-si
- Priority: KR10-2023-0068170 20230526
- Main IPC: G06N3/0895
- IPC: G06N3/0895

Abstract:
There is provided a learning method and system of a backbone network for visual intelligence based on self-supervised learning and multi-head. A network learning system according to an embodiment generates a plurality of first modified vectors by modifying a first feature vector outputted from a teacher network, generates a plurality of second modified vectors by modifying a second feature vector outputted from a student network, calculates a loss by using the first modified vectors and the second modified vectors, and optimizes parameters of the student network. Accordingly, the effect of learning by knowledge distillation may be enhanced by training the backbone network for visual intelligence like group learning is performed by various teacher networks and student networks.
Information query