公开(公告)号：US20240331425A1

公开(公告)日：2024-10-03

申请号：US18460680

申请日：2023-09-04

Applicant: ZHEJIANG LAB

Inventor： Yao QI ,  Hongyang CHEN ,  Jingsong LV ,  Wentao YANG

IPC: G06V30/19 ,  G06N5/02

CPC classification number: G06V30/19187 ,  G06N5/02 ,  G06V30/19173

Abstract: A method, a device, computer equipment and a storage medium for identify an illegal commodity. The method comprises: firstly, constructing a multi-modal knowledge graph according to a multi-modal knowledge graph data set, and extracting visual features of all visual modality entities and text features of all text modality entities in the knowledge graph; then obtaining a commodity image and a commodity text according to a database; then, generating commodity visual feature according to the commodity image; then generating the commodity text feature according to the commodity text; secondly, according to the visual features and text features, as well as the commodity visual feature and the commodity text feature, linking the commodity image and the commodity text to the knowledge graph by using an entity linking method; finally, obtaining the correlation between the commodity image and the commodity text according to the linked knowledge graph to determine the illegality of the commodity.