公开(公告)号：US20230376840A1

公开(公告)日：2023-11-23

申请号：US17896942

申请日：2022-08-26

Applicant: Salesforce, Inc.

Inventor： Hung Le ,  Yue Wang ,  Akhilesh Deepak Gotmare ,  Chu Hong Hoi

IPC: G06N20/00 ,  G06F40/284 ,  G06K9/62

CPC classification number: G06N20/00 ,  G06F40/284 ,  G06K9/6262

Abstract: Embodiments described herein provide a reinforcement learning based framework engaging pretrained language models (LMs) for program synthesis tasks. Specifically, the framework adopts a training strategy that optimizes pretrained LMs for program synthesis tasks in an actor-critic approach.

公开(公告)号：US20240289606A1

公开(公告)日：2024-08-29

申请号：US18174547

申请日：2023-02-24

Applicant: Salesforce, Inc.

Inventor： Yue Wang ,  Hung Le ,  Akhilesh Deepak Gotmare ,  Junnan Li ,  Chu Hong Hoi

IPC: G06N3/08

CPC classification number: G06N3/08

Abstract: Embodiments described herein provide a mixture of encoder-decoder Transformer framework for multi-task pretraining and flexible finetuning for both code understanding and generation tasks. Specifically, the framework is built on multimodal encoder and decoder modules. During pre-training, the encoder-decoder framework is trained with multiple learning objectives, including a diverse set of self-supervised tasks over two major stages of pretraining on unimodal and bimodal data.

公开(公告)号：US20230376841A1

公开(公告)日：2023-11-23

申请号：US17896946

申请日：2022-08-26

Applicant: Salesforce, Inc.

Inventor： Hung Le ,  Yue Wang ,  Akhilesh Deepak Gotmare ,  Chu Hong Hoi

IPC: G06N20/00 ,  G06F40/284 ,  G06K9/62 ,  G06F40/289

CPC classification number: G06N20/00 ,  G06F40/284 ,  G06K9/6256 ,  G06F40/289

Abstract: Embodiments described herein provide a reinforcement learning based framework engaging pretrained language models (LMs) for program synthesis tasks. Specifically, the framework adopts a training strategy that optimizes pretrained LMs for program synthesis tasks in an actor-critic approach.