- 专利标题: IMAGE QUESTIONING AND ANSWERING METHOD, APPARATUS, DEVICE AND STORAGE MEDIUM
-
申请号: EP21275029.3申请日: 2021-03-16
-
公开(公告)号: EP3885935A1公开(公告)日: 2021-09-29
- 发明人: QIN, Xiameng , LI, Yulin , HUANG, Ju , XIE, Qunyi , HAN, Junyu
- 申请人: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO. LTD.
- 申请人地址: CN 100085 Beijing 2/F Baidu Campus, No. 10, Shangdi 10th, Haidian District
- 代理机构: Wilson Gunn
- 优先权: CN202010603698 20200629
- 主分类号: G06F16/583
- IPC分类号: G06F16/583 ; G06F16/332
摘要:
The present application discloses an image questioning and answering method, apparatus, device and storage medium, relating to the technical field of image processing, computer vision, deep learning and natural language processing. The specific implementation solution is as follows: constructing a question graph with a topological structure and extracting a question feature of a query sentence, according to the query sentence; constructing a visual graph with a topological structure and a text graph with a topological structure according to a target image corresponding to the query sentence; performing fusion on the visual graph, the text graph and the question graph by using a fusion model, to obtain a final fusion graph; and determining reply information of the query sentence according to a reasoning feature extracted from the final fusion graph and the question feature.
信息查询