MODELING MASTERY IN DISTRIBUTED COGNITIVE SYSTEMS AND STORING THE RESULTS IN A LEDGER

    公开(公告)号:US20200065697A1

    公开(公告)日:2020-02-27

    申请号:US16108324

    申请日:2018-08-22

    Abstract: Techniques for assessing the proficiency of artificial intelligence agents and users in a given knowledge domain are described. A plurality of proficiency agents can be initialized with a plurality of proficiency scores, by performing a plurality of assessments between pairs of proficiency agents selected from the plurality of proficiency agents. A first client device associated with a first user is matched with a first proficiency agent of the plurality of proficiency agents, based on a first proficiency score associated with the first user and a second proficiency score of the plurality of proficiency scores corresponding to the first proficiency agent. Assessments results of an assessment performed between the first client device and the first proficiency agent are received, and a rating system update function is used to update the first proficiency score and the second proficiency score, based on the assessment results.

    NO-GROUND TRUTH SHORT ANSWER SCORING
    3.
    发明申请

    公开(公告)号:US20200020243A1

    公开(公告)日:2020-01-16

    申请号:US16031062

    申请日:2018-07-10

    Abstract: Systems, methods, and computer-readable media are described for determining a score for a target student answer using unlabeled data. The target answer is provided by a student to a question for which there is no ground-truth answer data. A set of student answers serves as a set of pseudo-reference answers and a classifier is used to score each answer based on each other answer. In this manner, each student answer serves as a pseudo-reference answer for each other student answer. A clustering approach can also be employed to cluster a set of student answers into clusters. The centroids of the clusters can then serve as the set of pseudo-reference answers. Clustering improves the robustness and efficiency of the score determined for a target student answer.

Patent Agency Ranking