公开(公告)号：US20230394079A1

公开(公告)日：2023-12-07

申请号：US18453838

申请日：2023-08-22

Applicant: Samsung Electronics Co., Ltd.

Inventor： Haotian ZHANG ,  Allan JEPSON ,  Iqbal Ismail MOHOMED ,  Konstantinos DERPANIS ,  Ran ZHANG ,  Afsaneh FAZLY

IPC: G06F16/535 ,  G06N20/00

CPC classification number: G06F16/535 ,  G06N20/00

Abstract: A method of personalized image retrieval includes obtaining a natural language query including a name; replacing the name in the natural language query with a generic term to provide an anonymized query and named entity information; obtaining a plurality of initial ranking scores and a plurality of attention weights corresponding to a plurality of images using a trained scoring model that inputs the anonymized query and the plurality of images; obtaining a plurality of delta scores corresponding to the plurality of images using a re-scoring model that inputs the plurality of attention weights and the named entity information; and obtaining a plurality of final ranking scores by modifying the plurality of initial ranking scores based on the plurality of delta scores. The trained scoring model performs semantic based searching and the re-scoring model determines a probability that faces detected in the plurality of images correspond to the name.

公开(公告)号：US20220269719A1

公开(公告)日：2022-08-25

申请号：US17465408

申请日：2021-09-02

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Haotian ZHANG ,  Allan Jepson ,  Iqbal Ismail Mohomed ,  Konstantinos Derpanis ,  Ran Zhang ,  Afsaneh Fazly

IPC: G06F16/535 ,  G06N20/00

Abstract: A method of personalized image retrieval includes obtaining a natural language query including a name; replacing the name in the natural language query with a generic term to provide an anonymized query and named entity information; obtaining a plurality of initial ranking scores and a plurality of attention weights corresponding to a plurality of images using a trained scoring model that inputs the anonymized query and the plurality of images; obtaining a plurality of delta scores corresponding to the plurality of images using a re-scoring model that inputs the plurality of attention weights and the named entity information; and obtaining a plurality of final ranking scores by modifying the plurality of initial ranking scores based on the plurality of delta scores. The trained scoring model performs semantic based searching and the re-scoring model determines a probability that faces detected in the plurality of images correspond to the name.