LEARNING LANGUAGE REPRESENTATION WITH LOGICAL INDUCTIVE BIAS

    公开(公告)号:US20240193399A1

    公开(公告)日:2024-06-13

    申请号:US18077723

    申请日:2022-12-08

    发明人: Jianshu CHEN

    IPC分类号: G06N3/04

    CPC分类号: G06N3/04 G06K9/6259

    摘要: A method including receiving input comprising natural language texts; pre-training a First-Order Logic Network (FOLNet) neural network model on unlabeled texts included in the natural language texts, the FOLNet neural network model comprising of a plurality of layers; processing the input through the plurality of layers of the FOLNet neural network model; encoding a logical inductive bias using the FOLNet neural network model; outputting one or more tensors based on the logical inductive bias; and predicting an outcome using the one or more tensors.