公开(公告)号：US20230098276A1

公开(公告)日：2023-03-30

申请号：US17951899

申请日：2022-09-23

申请人： ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ,  THE INDUSTRY & ACADEMIC COOPERATION IN CHUNGNAM NATIONAL UNIVERSITY (IAC)

发明人： Hee-Kyung LEE ,  Gi-Mun UM ,  Dae-Young SONG ,  Dong-Hyeon CHO

IPC分类号： G06T3/40 ,  G06T3/00 ,  G06T5/50

摘要： Disclosed herein are a method and apparatus for generating a panoramic image. The method includes configuring a data set for training a deep learning network based on K images, extracting an encoding feature map, a skip connection feature map, and a decoding feature map based on K/2 images, among the images, estimating multiple homographies based on the encoding feature map, estimating a flow adjustment map, a preprocessing blending map, a weight map, and a post-processing blending map based on the decoding feature map, deriving a flow map based on the multiple homographies and the flow adjustment map, generating a preprocessed image based on the preprocessing blending map, generating multiple warped images based on the preprocessed image and the flow map, generating a matching image based on the warped images and the weight map, and correcting the matching image based on the matching image and the post-processing blending map.

公开(公告)号：US20220164922A1

公开(公告)日：2022-05-26

申请号：US17532880

申请日：2021-11-22

申请人： ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ,  THE INDUSTRY & ACADEMIC COOPERATION IN CHUNGNAM NATIONAL UNIVERSITY (IAC)

发明人： Gi Mun UM ,  Hee Kyung LEE ,  Dae-Young SONG ,  Donghyeon CHO

IPC分类号： G06T3/40 ,  G06T3/00 ,  G06K9/62

摘要： A deep learning-based image stitching method and apparatus are provided. The deep learning-based image stitching method includes receiving a plurality of images including a first image and a second image stitched to the first image, extracting a feature map of the plurality of images, generating a plurality of flow maps indicating movement information of pixels of the plurality of images, based on the feature map, generating a plurality of warping images in which the pixels of the plurality of images are moved, by applying the plurality of flow maps to the plurality of images, respectively, generating a plurality of weight maps for blending the plurality of warping images, based on the feature map, and generating a stitch image in which the first image and the second image are stitched, by blending the plurality of warping images based on the plurality of weight maps.