Automatic evaluation of argumentative writing by young students

    公开(公告)号:US12046155B1

    公开(公告)日:2024-07-23

    申请号:US17223390

    申请日:2021-04-06

    IPC分类号: G09B7/02 G06F40/20 G06N20/00

    CPC分类号: G09B7/02 G06F40/20 G06N20/00

    摘要: Systems and methods are provided for automatic evaluation of argument critique essays written by young students in response to prompts. A transformer pre-trained for natural language processing is employed as a machine learning model, which is fine-tune with a first training dataset comprising unannotated argument critique essays written by college students, and then fine-tuned with a second training dataset comprising annotated argument critique essays written by middle school students, where each sentence in the second training dataset is annotated for the presence of valid critiques to prompts. The fine-tuned machine learning model is used to classify each sentence in an essay to be evaluated as either containing a valid critique or not.

    Systems and methods for detecting co-occurrence of behavior in collaborative interactions

    公开(公告)号:US11556754B1

    公开(公告)日:2023-01-17

    申请号:US15452809

    申请日:2017-03-08

    IPC分类号: G06N3/00 G06N20/00 G06F16/22

    摘要: Systems and methods for computer-implemented evaluation of a performance are provided. In a first aspect, a computer-implemented method of evaluating an interaction generates a first temporal record of first behavior features exhibited by a first entity during an interaction between a first entity and a second entity. A second temporal record is generated including second behavior features exhibited by a second entity during an interaction with a first entity. A determination is made that a first feature of a first temporal record is associated with a second feature of a second temporal record. The length of time that passes between the first feature and second feature is evaluated, and a determination is made that the length of time satisfies a temporal condition. A co-occurrence record associated with a first feature and a second feature is generated and included in a co-occurrence record data-structure.

    Computer-implemented systems and methods for detection of sentiment in writing

    公开(公告)号:US11410072B2

    公开(公告)日:2022-08-09

    申请号:US13655528

    申请日:2012-10-19

    摘要: Systems and methods are provided for the detection of sentiment in writing. A plurality of texts is received from a larger collection of writing samples with a computer system. A set of seed words from the plurality of texts are labeled as being of positive sentiment or of negative sentiment with the computer system. The set of seed words is expanded in size with the computer system to provide an expanded set of seed words. Intensity values are assigned to words of the expanded set of seed words. Each of the words of the expanded set of seed words is assigned three intensity values: a value corresponding to the strength of the word's association with a positive polarity class, a value corresponding to the strength of the word's association with a negative polarity class, and a value corresponding to the strength of the word's association with a neutral polarity class.

    Systems and methods for automatic generation of questions from text

    公开(公告)号:US11023684B1

    公开(公告)日:2021-06-01

    申请号:US16357400

    申请日:2019-03-19

    摘要: Computer-implemented systems and methods are described herein for automatically generating questions from text. Text including one or more sentences is received. A sentence, comprising a predicate and one or more arguments associated with the predicate, is parsed from the text. Semantic role labels are assigned to the one or more arguments associated with the predicate. One or more questions are automatically generated relating to the predicate based on the assigned semantic role labels. Each answer to the generated questions is one of the one or more arguments associated with the predicate.

    Systems and methods for generating a personalization score for a constructed response

    公开(公告)号:US10769962B1

    公开(公告)日:2020-09-08

    申请号:US15145459

    申请日:2016-05-03

    IPC分类号: G09B19/00

    摘要: Computer-implemented systems and methods for generating a personalization score for a constructed response are provided. A constructed response generated by a user is received. The constructed response is processed with a processing system to generate one or more feature values representative of one or more aspects of the constructed response. A personalization score for the constructed response is generated using the processing system by applying a computer scoring model to the one or more feature values. The personalization score provides a measure of a personalization of the constructed response.

    Systems and methods for natural language processing for speech content scoring

    公开(公告)号:US10755595B1

    公开(公告)日:2020-08-25

    申请号:US15708213

    申请日:2017-09-19

    IPC分类号: G09B7/02 G10L15/01 G10L15/06

    摘要: Computer-implemented systems and methods are provided for scoring content of a spoken response to a prompt. A scoring model is generated for a prompt, where generating the scoring model includes generating a transcript for each of a plurality of training responses to the prompt, dividing the plurality of training responses into clusters based on the transcripts of the training responses, selecting a subset of the training responses in each cluster for scoring, scoring the selected subset of training responses for each cluster, and generating content training vectors using the transcripts from the scored subset. A transcript is generated for a received spoken response to be scored, and a similarity metric is computed between the transcript of the spoken response to be scored and the content training vectors. A score is assigned to the spoken response based on the determined similarity metric.

    Systems and methods for providing a multi-modal evaluation of a presentation

    公开(公告)号:US10706738B1

    公开(公告)日:2020-07-07

    申请号:US16392010

    申请日:2019-04-23

    IPC分类号: G09B19/00

    摘要: Systems and methods are described for providing a multi-modal evaluation of a presentation. A system includes a motion capture device configured to detect motion an examinee giving a presentation and an audio recording device configured to capture audio of the examinee giving the presentation. One or more data processors are configured to extract a non-verbal feature of the presentation based on data collected by the motion capture device and an audio feature of the presentation based on data collected by the audio recording device. The one or more data processors are further configured to generate a presentation score based on the non-verbal feature and the audio feature.