TECHNIQUES FOR ENHANCING THE QUALITY OF HUMAN ANNOTATION

    公开(公告)号:US20230161961A1

    公开(公告)日:2023-05-25

    申请号:US18099891

    申请日:2023-01-20

    Applicant: eBay Inc.

    Abstract: Methods for enhancing or automating a review process of annotation tags for a set of tokens is described. A system may receive a list of tokens with associated tags for each token for a data set and may output any identified inconsistencies where a token is assigned at least two different tags. For example, instead of a human looking at each token individually or taking a sample set of the tags for review, the described techniques may look at all tokens with the associated tags in a set of data and may leverage reorganizing the tokens and associated tags to highlight errors to be fixed. Accordingly, the system may look across all tokens within an entire data set, while a review (e.g., by a human) of possible errors of the data set is limited to the highlighted errors flagged by the system.

    Techniques for enhancing the quality of human annotation

    公开(公告)号:US12277392B2

    公开(公告)日:2025-04-15

    申请号:US18099891

    申请日:2023-01-20

    Applicant: eBay Inc.

    Abstract: Methods for enhancing or automating a review process of annotation tags for a set of tokens is described. A system may receive a list of tokens with associated tags for each token for a data set and may output any identified inconsistencies where a token is assigned at least two different tags. For example, instead of a human looking at each token individually or taking a sample set of the tags for review, the described techniques may look at all tokens with the associated tags in a set of data and may leverage reorganizing the tokens and associated tags to highlight errors to be fixed. Accordingly, the system may look across all tokens within an entire data set, while a review (e.g., by a human) of possible errors of the data set is limited to the highlighted errors flagged by the system.

    Techniques for enhancing the quality of human annotation

    公开(公告)号:US11586820B2

    公开(公告)日:2023-02-21

    申请号:US16989879

    申请日:2020-08-10

    Applicant: eBay Inc.

    Abstract: Methods for enhancing or automating a review process of annotation tags for a set of tokens is described. A system may receive a list of tokens with associated tags for each token for a data set and may output any identified inconsistencies where a token is assigned at least two different tags. For example, instead of a human looking at each token individually or taking a sample set of the tags for review, the described techniques may look at all tokens with the associated tags in a set of data and may leverage reorganizing the tokens and associated tags to highlight errors to be fixed. Accordingly, the system may look across all tokens within an entire data set, while a review (e.g., by a human) of possible errors of the data set is limited to the highlighted errors flagged by the system.

Patent Agency Ranking