公开(公告)号：US20210073617A1

公开(公告)日：2021-03-11

申请号：US16567277

申请日：2019-09-11

Applicant: Amazon Technologies, Inc.

Inventor： Loris Bazzani ,  Maksim Lapin ,  Felix Hieber ,  Tobias Domhan

IPC: G06N3/04 ,  G06N3/10 ,  G06N20/00 ,  G06K9/62 ,  G06F17/18 ,  G06F17/16 ,  G06F17/21

Abstract: Techniques are generally described for automatic scoring of alt-text for image data. In various examples, first image data and first text data describing the first image data may be received. A feature representation of the first image data may be determined using an encoder machine learning model. A hidden state representation may be determined using a decoder machine learning model based on the feature representation and a first word of the first text data. In some examples, a first score may be determined using the hidden state representation. The first score may include an indication of a descriptive capability of the first text data with respect to the first image data.

公开(公告)号：US11361212B2

公开(公告)日：2022-06-14

申请号：US16567277

申请日：2019-09-11

Applicant: Amazon Technologies, Inc.

Inventor： Loris Bazzani ,  Maksim Lapin ,  Felix Hieber ,  Tobias Domhan

IPC: G06N3/04 ,  G06N20/00 ,  G06F40/117 ,  G06F17/16 ,  G06F17/18 ,  G06K9/62 ,  G06N3/10

Abstract: Techniques are generally described for automatic scoring of alt-text for image data. In various examples, first image data and first text data describing the first image data may be received. A feature representation of the first image data may be determined using an encoder machine learning model. A hidden state representation may be determined using a decoder machine learning model based on the feature representation and a first word of the first text data. In some examples, a first score may be determined using the hidden state representation. The first score may include an indication of a descriptive capability of the first text data with respect to the first image data.