公开(公告)号：US20240354508A1

公开(公告)日：2024-10-24

申请号：US18761154

申请日：2024-07-01

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

CPC classification number: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US12056454B2

公开(公告)日：2024-08-06

申请号：US18201075

申请日：2023-05-23

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

CPC classification number: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US11687720B2

公开(公告)日：2023-06-27

申请号：US17306010

申请日：2021-05-03

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06N20/00 ,  G06N3/08 ,  G06F40/30

CPC classification number: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US20230385551A1

公开(公告)日：2023-11-30

申请号：US18201075

申请日：2023-05-23

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06N20/00 ,  G06N3/08 ,  G06F40/30

CPC classification number: G06F40/295 ,  G06N20/00 ,  G06N3/08 ,  G06F40/30

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US20210256213A1

公开(公告)日：2021-08-19

申请号：US17306010

申请日：2021-05-03

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US11017173B1

公开(公告)日：2021-05-25

申请号：US16230341

申请日：2018-12-21

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06N20/00 ,  G06N3/08 ,  G06F40/30

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.