Image segmentation method and system using GAN architecture

    公开(公告)号:US12086712B2

    公开(公告)日:2024-09-10

    申请号:US17512463

    申请日:2021-10-27

    摘要: There are provided a method and a system for image segmentation utilizing a GAN architecture. A method for training an image segmentation network according to an embodiment includes: inputting an image to a first network which is trained to output a region segmentation result regarding an input image, and generating a region segmentation result; and inputting the region segmentation result generated at the generation step and a ground truth (GT) to a second network, and acquiring a discrimination result, the second network being trained to discriminate inputted region segmentation results as a result generated by the first network and a GT, respectively; and training the first network and the second network by using the discrimination result. Accordingly, region segmentation performance of a semantic segmentation network regarding various images can be enhanced, and a very small image region can be exactly segmented.

    Method for audio synthesis adapted to video characteristics

    公开(公告)号:US10923106B2

    公开(公告)日:2021-02-16

    申请号:US16256835

    申请日:2019-01-24

    摘要: An audio synthesis method adapted to video characteristics is provided. The audio synthesis method according to an embodiment includes: extracting characteristics x from a video in a time-series way; extracting characteristics p of phonemes from a text; and generating an audio spectrum characteristic St used to generate an audio to be synthesized with a video at a time t, based on correlations between an audio spectrum characteristic St-1, which is used to generate an audio to be synthesized with a video at a time t−1, and the characteristics x. Accordingly, an audio can be synthesized according to video characteristics, and speech according to a video can be easily added.

    Image region segmentation method and system using self-spatial adaptive normalization

    公开(公告)号:US11605167B2

    公开(公告)日:2023-03-14

    申请号:US17126299

    申请日:2020-12-18

    摘要: An image region segmentation method and system suing self-spatial adaptive normalization is provided. The image region segmentation system includes: an encoder configured to encode an image for segmenting a region by using a plurality of encoding blocks; and a decoder configured to decode the image encoded by the encoder and to generate a region-segmented image by using a plurality of decoding blocks, wherein each of the encoding blocks processes an inputted image into a convolution layer, performs spatial adaptive normalization, and then reduces the image and delivers the image to the next encoding block. Accordingly, spatial characteristics of the image are considered in an encoding process and a decoding process, so that region segmentation can be exactly performed with respect to various images.

    Method and system for automatic image caption generation

    公开(公告)号:US10726289B2

    公开(公告)日:2020-07-28

    申请号:US16043338

    申请日:2018-07-24

    摘要: A method and a system for automatic image caption generation are provided. The automatic image caption generation method according to an embodiment of the present disclosure includes: extracting a distinctive attribute from example captions of a learning image; training a first neural network for predicting a distinctive attribute from an image, by using a pair of the extracted distinctive attribute and the learning image; inferring a distinctive attribute by inputting the learning image to the trained first neural network; and training a second neural network for generating a caption of an image by using a pair of the inferred distinctive attribute and the learning image. Accordingly, a caption well indicating a feature of a given image is automatically generated, such that an image can be more exactly explained and a difference from other images can be clearly distinguished.

    ROBUST REGION SEGMENTATION METHOD AND SYSTEM USING THE SAME
    9.
    发明申请
    ROBUST REGION SEGMENTATION METHOD AND SYSTEM USING THE SAME 审中-公开
    使用相同方法的鲁棒区域分割方法和系统

    公开(公告)号:US20170076462A1

    公开(公告)日:2017-03-16

    申请号:US15259935

    申请日:2016-09-08

    摘要: Provided herein is a robust region segmentation method and a system using the same, the method including receiving setting of an image in an input image; calculating representative values for each of an internal portion and an external portion of the region; calculating a cost by substituting the representative values and a pixel value of the image in a cost function, and updating the region based on the calculated cost, wherein the cost function includes a term in which a difference between the updated pixel value and an original pixel value is reflected, thereby enabling an accurate region segmentation even in ambiguous images that are complicated and where division of regions is unclear.

    摘要翻译: 本文提供了鲁棒区域分割方法和使用该方法的系统,该方法包括接收输入图像中的图像的设置; 计算该区域的内部部分和外部部分中的每一个的代表值; 通过在成本函数中代替图像的代表值和像素值来计算成本,并且基于计算出的成本来更新该区域,其中,成本函数包括其中更新的像素值和原始像素之间的差值 反映了这一点,从而即使在复杂的模糊图像中也能进行精确的区域分割,并且区域划分不清楚。