- 专利标题: LEARNING METHOD AND LEARNING DEVICE FOR NEURAL NETWORK AT ADAPTIVE LEARNING RATE, AND TESTING METHOD AND TESTING DEVICE USING THE SAME
-
申请号: EP19184966.0申请日: 2019-07-08
-
公开(公告)号: EP3637329A1公开(公告)日: 2020-04-15
- 发明人: Kim, Kye-Hyeon , Kim, Yongjoong , Kim, Insu , Kim, Hak-Kyoung , Nam, Woonhyun , Boo, SukHoon , Sung, Myungchul , Yeo, Donghun , Ryu, Wooju , Jang, Taewoong , Jeong, Kyungjoong , Je, Hongmo , Cho, Hojin
- 申请人: Stradvision, Inc.
- 申请人地址: No. 4427, 4 research bldg. RIST 67, Cheongam-ro Nam-Gu Pohang, Gyeongsangbuk 37673 KR
- 专利权人: Stradvision, Inc.
- 当前专利权人: Stradvision, Inc.
- 当前专利权人地址: No. 4427, 4 research bldg. RIST 67, Cheongam-ro Nam-Gu Pohang, Gyeongsangbuk 37673 KR
- 代理机构: V.O.
- 优先权: US201816154060 20181008
- 主分类号: G06N3/08
- IPC分类号: G06N3/08 ; G06N3/04
摘要:
A method for learning a neural network by adjusting a learning rate each time when an accumulated number of iterations reaches one of a first to an n-th specific values. The method includes steps of: (a) a learning device, while increasing k from 1 to (n-1), (b1) performing a k-th learning process of repeating the learning of the neural network at a k-th learning rate by using a part of the training data while the accumulated number of iterations is greater than a (k-1)-th specific value and is equal to or less than a k-th specific value, (b2) changing a k-th gamma to a (k+1)-th gamma by referring to k-th losses of the neural network which are obtained by the k-th learning process and (ii) changing a k-th learning rate to a (k+1)-th learning rate by using the (k+1)-th gamma.
信息查询