- 专利标题: Method and system for automatic image caption generation
-
申请号: US16043338申请日: 2018-07-24
-
公开(公告)号: US10726289B2公开(公告)日: 2020-07-28
- 发明人: Bo Eun Kim , Choong Sang Cho , Hye Dong Jung , Young Han Lee
- 申请人: Korea Electronics Technology Institute
- 申请人地址: KR Seongnam-si
- 专利权人: Korea Electronics Technology Institute
- 当前专利权人: Korea Electronics Technology Institute
- 当前专利权人地址: KR Seongnam-si
- 代理机构: NSIP Law
- 优先权: com.zzzhc.datahub.patent.etl.us.BibliographicData$PriorityClaim@fb6b234
- 主分类号: G06K9/46
- IPC分类号: G06K9/46 ; G06T7/00 ; G06N5/04 ; G06N3/08 ; G06F40/20 ; G06F40/169 ; G06N3/04 ; G06N5/02
摘要:
A method and a system for automatic image caption generation are provided. The automatic image caption generation method according to an embodiment of the present disclosure includes: extracting a distinctive attribute from example captions of a learning image; training a first neural network for predicting a distinctive attribute from an image, by using a pair of the extracted distinctive attribute and the learning image; inferring a distinctive attribute by inputting the learning image to the trained first neural network; and training a second neural network for generating a caption of an image by using a pair of the inferred distinctive attribute and the learning image. Accordingly, a caption well indicating a feature of a given image is automatically generated, such that an image can be more exactly explained and a difference from other images can be clearly distinguished.
公开/授权文献
- US20190286931A1 METHOD AND SYSTEM FOR AUTOMATIC IMAGE CAPTION GENERATION 公开/授权日:2019-09-19
信息查询