公开(公告)号：US20220406034A1

公开(公告)日：2022-12-22

申请号：US17822898

申请日：2022-08-29

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Jingru GAN ,  Haiwei WANG ,  Jinchang LUO ,  Kunbin CHEN ,  Wei HE ,  Shuhui WANG

IPC: G06V10/74 ,  G06F40/295 ,  G06V10/80

Abstract: A method for extracting information, includes: obtaining an information stream comprising text and an image; generating, according to the text, embedded representations of textual entity mentions and a textual similarity matrix of the textual entity mentions and candidate textual entities; generating, according to the image, embedded representations of image entity mentions and an image similarity matrix of the image entity mentions and candidate image entities; and determining, based on an optimal transport, target textual entities of the textual entity mentions and target image entities of the image entity mentions according to the embedded representations of the textual entity mentions, the embedded representations of the image entity mentions, the textual similarity matrix and the image similarity matrix.