公开(公告)号：US20250131273A1

公开(公告)日：2025-04-24

申请号：US18696052

申请日：2023-09-27

Applicant: Google LLC

Inventor： Soroosh Mariooryad ,  Sean Matthew Shannon ,  Thomas Edward Bagby ,  Siyuan Ma ,  David Teh-Hwa Kao ,  Daisy Antonia Stanton ,  Eric Dean Battenberg ,  Russell John Wyatt Skerry-Ryan

IPC: G06N3/088 ,  G06N3/0455

Abstract: Provided is a noisy channel generative model of two sequences, for example text and speech, which enables uncovering the associations between the two modalities when limited paired data is available. To address the intractability of the exact model under a realistic data set-up, example aspects of the present disclosure include a variational inference approximation. To train this variational model with categorical data, a KL encoder loss approach is proposed which has connections to the wake-sleep algorithm.