-
81.
公开(公告)号:EP3690735A1
公开(公告)日:2020-08-05
申请号:EP20152672.0
申请日:2020-01-20
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , SHIN, Dongsoo , YEO, Donghun , RYU, Wooju , LEE, Myeong-Chun , LEE, Hyungsoo , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A method for achieving better performance in an autonomous driving while saving computing powers, by using confidence scores representing a credibility of an object detection which is generated in parallel with an object detection process is provided. And the method includes steps of: (a) a computing device acquiring at least one circumstance image on surroundings of a subject vehicle, through at least one panorama view sensor installed on the subject vehicle; (b) the computing device instructing a Convolutional Neural Network(CNN) to apply at least one CNN operation to the circumstance image, to thereby generate initial object information and initial confidence information on the circumstance image; and (c) the computing device generating final object information on the circumstance image by referring to the initial object information and the initial confidence information.
-
82.
公开(公告)号:EP3690723A1
公开(公告)日:2020-08-05
申请号:EP20152861.9
申请日:2020-01-21
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , SHIN, Dongsoo , YEO, Donghun , RYU, Wooju , LEE, Myeong-Chun , LEE, Hyungsoo , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A learning method for generating integrated object detection information of an integrated image by integrating first object detection information and second object detection information is provided. The method includes steps of: (a) a learning device, if the first object detection information and the second object detection information is acquired, instructing a concatenating network included in a DNN to generate pair feature vectors including information on pairs of first original ROIs and second original ROIs; (b) the learning device instructing a determining network included in the DNN to apply FC operations to the pair feature vectors, to thereby generate (i) determination vectors and (ii) box regression vectors; (c) the learning device instructing a loss unit to generate an integrated loss, and performing backpropagation processes by using the integrated loss, to thereby learn at least part of parameters included in the DNN.
-
公开(公告)号:EP3690719A1
公开(公告)日:2020-08-05
申请号:EP20152682.9
申请日:2020-01-20
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , SHIN, Dongsoo , YEO, Donghun , RYU, Wooju , LEE, Myeong-Chun , LEE, Hyungsoo , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A method for achieving better performance in an autonomous driving while saving computing powers, by using confidence scores representing a credibility of an object detection which is generated in parallel with an object detection process is provided. And the method includes steps of: (a) a computing device acquiring at least one circumstance image on surroundings of a subject vehicle, through at least one panorama view sensor installed on the subject vehicle; (b) the computing device instructing a Convolutional Neural Network(CNN) to apply at least one CNN operation to the circumstance image, to thereby generate initial object information and initial confidence information on the circumstance image; and (c) the computing device generating final object information on the circumstance image by referring to the initial object information and the initial confidence information, with a support of an RL agent.
-
公开(公告)号:EP3690712A1
公开(公告)日:2020-08-05
申请号:EP20151836.2
申请日:2020-01-14
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Insu , KIM, Hak-Kyoung , NAM, Woonhyun , Boo, SukHoon , SUNG, Myungchul , YEO, Donghun , RYU, Wooju , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A method for learning a pedestrian detector to be used for robust surveillance or military purposes based on image analysis is provided for a solution to a lack of labeled images and for a reduction of annotation costs. The method can be also performed by using generative adversarial networks (GANs). The method includes steps of: a learning device generating an image patch by cropping each of regions on a training image, and instructing an adversarial style transformer to generate a transformed image patch by converting each of pedestrians into transformed pedestrians capable of impeding a detection; and generating a transformed training image by replacing each of the regions with the transformed image patch, instructing the pedestrian detector to detecting the transformed pedestrians, and learning parameters of the pedestrian detector to minimize losses. This learning, as a self-evolving system, is robust to adversarial patterns by generating training data including hard examples.
-
公开(公告)号:EP3690707A1
公开(公告)日:2020-08-05
申请号:EP20151414.8
申请日:2020-01-13
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Insu , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , YEO, Donghun , RYU, Wooju , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A post-processing method for detecting lanes to plan the drive path of an autonomous vehicle by using a segmentation score map and a clustering map is provided. The method includes steps of: a computing device acquiring the segmentation score map and the clustering map from a CNN; instructing a post-processing module to detect lane elements including pixels forming the lanes referring to the segmentation score map and generate seed information referring to the lane elements, the segmentation score map, and the clustering map; instructing the post-processing module to generate base models referring to the seed information and generate lane anchors referring to the base models; instructing the post-processing module to generate lane blobs referring to the lane anchors; and instructing the post-processing module to detect lane candidates referring to the lane blobs and generate a lane model by line-fitting operations on the lane candidates.
-
公开(公告)号:EP3689708A1
公开(公告)日:2020-08-05
申请号:EP20153038.3
申请日:2020-01-22
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , SHIN, Dongsoo , YEO, Donghun , RYU, Wooju , LEE, Myeong-Chun , LEE, Hyungsoo , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A method for delivering a steering intention of an autonomous driving module to a steering apparatus more accurately by using a reference map is provided. And the method includes steps of: (a) a computing device, if a subject intended steering signal inputted by the autonomous driving module at a current timing is acquired, instructing a signal adjustment module to select, by referring to the reference map, specific reference steering guide values corresponding to the subject intended steering signal; (b) the computing device (i) adjusting the subject intended steering signal by referring to the specific reference steering guide values, in order to generate a subject adjusted steering signal, and (ii) transmitting the subject adjusted steering signal to the steering apparatus, to thereby support the steering apparatus to rotate the subject vehicle by a specific steering angle corresponding to the subject intended steering signal.
-
公开(公告)号:EP3687152A1
公开(公告)日:2020-07-29
申请号:EP19215127.2
申请日:2019-12-11
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Insu , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , YEO, Donghun , RYU, Wooju , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
IPC分类号: H04N1/64
摘要: A method for pooling at least one ROI by using one or more masking parameters is provided. The method is applicable to mobile devices, compact networks, and the like via hardware optimization. The method includes steps of: (a) a computing device, if an input image is acquired, instructing a convolutional layer of a CNN to generate a feature map corresponding to the input image; (b) the computing device instructing an RPN of the CNN to determine the ROI corresponding to at least one object included in the input image by using the feature map; (c) the computing device instructing an ROI pooling layer of the CNN to apply each of pooling operations correspondingly to each of sub-regions in the ROI by referring to each of the masking parameters corresponding to each of the pooling operations, to thereby generate a masked pooled feature map.
-
公开(公告)号:EP3686849A1
公开(公告)日:2020-07-29
申请号:EP20151840.4
申请日:2020-01-14
申请人: StradVision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Insu , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , YEO, Donghun , RYU, Wooju , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A method for learning a runtime input transformation of real images into virtual images by using a cycle GAN capable of being applied to domain adaptation is provided. The method can be also performed in virtual driving environments. The method includes steps of: (a) (i) instructing first transformer to transform a first image to second image, (ii-1) instructing first discriminator to generate a 1_1-st result, and (ii-2) instructing second transformer to transform the second image to third image, whose characteristics are same as or similar to those of the real images; (b) (i) instructing the second transformer to transform a fourth image to fifth image, (ii-1) instructing second discriminator to generate a 2_1-st result, and (ii-2) instructing the first transformer to transform the fifth image to sixth image; (c) calculating losses. By the method, a gap between virtuality and reality can be reduced, and annotation costs can be reduced.
-
公开(公告)号:EP3686842A1
公开(公告)日:2020-07-29
申请号:EP19208314.5
申请日:2019-11-11
申请人: Stradvision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Insu , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , YEO, Donghun , RYU, Wooju , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A learning method for segmenting an image having one or more lanes is provided to be used for supporting collaboration with HD maps required to satisfy level 4 of autonomous vehicles. The learning method includes steps of: a learning device instructing a CNN module (a) to apply convolution operations to the image, thereby generating a feature map, and apply deconvolution operations thereto, thereby generating segmentation scores of each of pixels on the image; (b) to apply Softmax operations to the segmentation scores, thereby generating Softmax scores; and (c) to (I) apply multinomial logistic loss operations and pixel embedding operations to the Softmax scores, thereby generating Softmax losses and embedding losses, where the embedding losses is used to increase inter-lane differences among averages of the segmentation scores and decrease intra-lane variances among the segmentation scores, in learning parameters of the CNN module, and (II) backpropagate the Softmax and the embedding losses.
-
公开(公告)号:EP3686807A2
公开(公告)日:2020-07-29
申请号:EP19208316.0
申请日:2019-11-11
申请人: Stradvision, Inc.
发明人: KIM, Kye-Hyeon , KIM, Yongjoong , KIM, Insu , KIM, Hak-Kyoung , NAM, Woonhyun , BOO, SukHoon , SUNG, Myungchul , YEO, Donghun , RYU, Wooju , JANG, Taewoong , JEONG, Kyungjoong , JE, Hongmo , CHO, Hojin
摘要: A method for an object detector to be used for surveillance based on a convolutional neural network capable of converting modes according to scales of objects is provided. The method includes steps of: a learning device (a) instructing convolutional layers to output a feature map by applying convolution operations to an image and instructing an RPN to output ROIs in the image; (b) instructing pooling layers to output first feature vectors by pooling each of ROI areas on the feature map per each of their scales, instructing first FC layers to output second feature vectors, and instructing second FC layers to output class information and regression information; and (c) instructing loss layers to generate class losses and regression losses by referring to the class information, the regression information, and their corresponding GTs.
-
-
-
-
-
-
-
-
-