公开(公告)号：US20240420680A1

公开(公告)日：2024-12-19

申请号：US18337168

申请日：2023-06-19

Applicant: GOOGLE LLC

Inventor： Te I ,  Chris Kau ,  Jeffrey Robert Pitman ,  Robert Eric Genter ,  Qi Ge ,  Wolfgang Macherey ,  Dirk Ryan Padfield ,  Naveen Arivazhagan ,  Colin Cherry

IPC: G10L13/08 ,  G10L13/10 ,  G10L15/00 ,  G10L15/26

Abstract: Implementations relate to a multimodal translation application that can provide an abridged version of a translation through an audio interface of a computing device, while simultaneously providing a verbatim textual translation at a display interface of the computing device. The application can provide these different versions of the translation in certain circumstances when, for example, the rate of speech of a person speaking to a user is relatively high compared to a preferred rate of speech of the user. For example, a comparison between phonemes of an original language speech and a translated language speech can be performed to determine whether the ratio satisfies a threshold for providing an audible abridged translation. A determination to provide the abridged translation can additionally or alternatively be based on a determined language of the speaker.

公开(公告)号：US20230376699A1

公开(公告)日：2023-11-23

申请号：US18245305

申请日：2020-12-18

Applicant: Google LLC

Inventor： Brandon Charles Barbello ,  Shenaz Zack ,  Tim Wantland ,  Khondokar Sami Iqram ,  Nikola Radicevic ,  Prasad Modali ,  Jeffrey Robert Pitman ,  Svetoslav Ganov ,  Qi Ge ,  Jonathan D. Wilson ,  Masakazu Seno ,  Xinxing Gu

IPC: G06F40/58

CPC classification number: G06F40/58

Abstract: This document describes methods and systems of on-device real-time translation for media content on a mobile electronic device. The translation is managed and executed by an operating system of the electronic device rather than within a particular application executing on the electronic device. The operating system can translate media content, including visual content displayed on a display device of the electronic device or audio content output by the electronic device. Because the translation is at the OS level, the translation can be implemented, automatically or based on a user input, across a variety of (including all) applications and a variety of content on the electronic device to provide a consistent translation experience, which is provided via a system UI overlay that displays translated text as captions to video content or as a replacement to on-screen text.