BACKBONE NETWORK LEARNING METHOD AND SYSTEM BASED ON SELF-SUPERVISED LEARNING AND MULTI-HEAD FOR VISUAL INTELLIGENCE
Abstract:
There is provided a learning method and system of a backbone network for visual intelligence based on self-supervised learning and multi-head. A network learning system according to an embodiment generates a plurality of first modified vectors by modifying a first feature vector outputted from a teacher network, generates a plurality of second modified vectors by modifying a second feature vector outputted from a student network, calculates a loss by using the first modified vectors and the second modified vectors, and optimizes parameters of the student network. Accordingly, the effect of learning by knowledge distillation may be enhanced by training the backbone network for visual intelligence like group learning is performed by various teacher networks and student networks.
Information query
Patent Agency Ranking
0/0