Hybrid transformer-based dialog processor

    公开(公告)号:US12032627B2

    公开(公告)日:2024-07-09

    申请号:US17526806

    申请日:2021-11-15

    IPC分类号: G06F16/60 G06F16/63 G06N20/00

    CPC分类号: G06F16/63 G06N20/00

    摘要: Systems and methods are provided for determining a response to a query in a dialog. An entity extractor extracts rules and conditions associated with the query and determines a particular task. The disclosed technology generates a transformer-based dialog embedding by pre-training a transformer using dialog corpora including a plurality of tasks. A task-specific classifier generates a first set of candidate responses based on rules and conditions associated with the task. The transformer-based dialog embedding generates a second set of candidate responses to the query. The classifier accommodates changes made to a task by an interactive dialog editor as machine teaching. A response generator generates a response based on the first and second sets of candidate responses using an optimization function. The disclosed technology leverages both a data-driven, generative model (a transformer) based on dialog corpora and a user-driven, task-specific rule-based classifier that accommodating updates in rules and conditions associated with a particular task.